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Cooperative Relay Broadcast Channels ^ ^ 

Yingbin Liang and Venugopal V. Veeravalli ^ 
Abstract 

The capacity regions are investigated for two relay broadcast channels (RBCs), where relay 
links are incorporated into standard two-user broadcast channels to support user cooperation. 
In the first channel, the Partially Cooperative Relay Broadcast Channel, only one user in the 
system can act as a relay and transmit to the other user through a relay link. An achievable rate 
region is derived based on the relay using the decode-and-forward scheme. An outer bound on 
the capacity region is derived and is shown to be tighter than the cut-set bound. For the special 
ps) ' case where the Partially Cooperative RBC is degraded, the achievable rate region is shown to 

be tight and provides the capacity region. Two Gaussian cases of the Partially Cooperative 
\ RBC are studied. For the system where the additive Gaussian noise term at one receiver is a 

degraded version of the other, which we refer to as the D-AWGN Partially Cooperative RBC, 
the capacity region is established. For the system where the additive Gaussian noise term at 
one receiver is independent of the other, which we refer to as the AWGN Partially Cooperative 
RBC, inner and outer bounds on the capacity region are derived and are shown to be close. 
Furthermore, it is shown that feedback does not increase the capacity region for the degraded 
Partially Cooperative RBC, but that it may improve the capacity region for the non-degraded 
O . Partially Cooperative RBC. In particular, feedback improves the capacity region for the AWGN 

Partially Cooperative RBC. In the second channel model being studied in the paper, the Fully 
Cooperative Relay Broadcast Channel, both users can act as relay nodes and transmit to each 
K*" \ other through relay links. This is a more general model than the Partially Cooperative RBC. 

' All the results for Partially Cooperative RBCs are correspondingly generalized to the Fully 

. Cooperative RBCs. In particular, the capacity regions are established for the degraded Fully 

\ Cooperative RBC and its Gaussian example of the D-AWGN Fully Cooperative RBC. The 

■ capacity region is also established for the Fully Cooperative RBC with feedback. It is further 

, shown that the AWGN Fully Cooperative RBC has a larger achievable rate region than the 

' AWGN Partially Cooperative RBC. The results illustrate that relaying and user cooperation 

O ' are powerful techniques in improving the capacity of broadcast channels. 

1 Introduction 
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Cooperative relaying of information between users is emerging as a powerful technique for improving 
the reliability and throughput of wireless networks. The building block of such relay networks, the 
three-terminal relay channel, was first introduced by van der Meulen j46j , and was comprehensively 
studied by Cover and El Gamal Recently, this channel has been further studied in a variety of 
contexts including Gaussian relay channels (e.g., fading relay channels (e.g., IHl OH 

1171 [TSl ITCl ISni I5n] ) , relay channels with complexity constraints [HH , relay channels with multiple 
antennas (e.g.,|211 ST]), and relay channels with orthogonal components (e.g., pHl ITHl IT^ [TTl OHl 
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1231 More complicated relay networks have also been studied including relay networks with 

multiple relay nodes simultaneously relaying information to the destination f^e.g.. j24l[Tllll^l^OH] ). 
relay networks with multiple levels of relay nodes forwarding information from one level to next 
(e.g.j^JUnillHlllllEni)) and relay networks with multiple cooperative sources or destinations (e.g., 
|16 |ll7[[T9l l2nj). Furthermore, these information-theoretic studies of relay networks have motivated 
practical relaying protocol and coding design to achieve user-cooperative diversity fe.g.. |27l05lllSl 

EHUU). 

For centralized networks, to date much of work on this topic has focused on the uplink (from 
the users to a base station or access point). Cooperative diversity schemes, where one user may 
share another user's resources to improve its transmission rate, have been explored in a number of 
recent works (see, e.g. [IHl Ellin])- The use of a relay node to assist all the users in a multi-access 
channel has been studied in HSH^QUll^) and bounds on the corresponding capacity region have 
been derived. 

In this paper, we study the impact of relaying and user cooperation on downlink systems. Since 
in centralized wireless networks such as cellular and WiFi data networks, mobile users have been 
demanding increasingly higher data rates on the downlink, improving the throughput on the down- 
link has become an extremely important issue. This application motivates us to study the downlink 
or broadcast channel that exploits the technique of relaying and user cooperation to achieve higher 
throughput. We introduce and study two such systems of relay broadcast channels (RBCs), where 
relay links are incorporated into the standard broadcast channel 1^ to assist broadcast trans- 
mission. These RBC models represent the most fundamental user-cooperative downlink systems 
and capture the essential roles of user cooperation in downlink communications. We focus on the 
two-user case of these RBCs, and study the gains in capacity region offered by relaying and user 
cooperation. 
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Figure 1: Partially Cooperative Relay Broadcast Channel 



We first study the Partially Cooperative Relay Broadcast Channel, which is based on the standard 
two-user broadcast channel with one source attempting to transmit both common information and 
private information sets to two users. Moreover, user 1 acts as a standard relay node |46l [3] 
and transmits cooperative information to user 2 through a relay link (see Figure ^ . A possible 
motivation for studying this channel is that in a two-user broadcast system usually one user (denoted 
by user 1) has a "better" channel from the source than the other user (denoted by user 2), and hence 
user 1 may decode the information intended for user 2 in addition to its own information. Then user 
2 should benefit from having a relay link from user 1. Such user cooperation is particularly useful 
when a mobile user experiences a deep fading state and can still maintain a reliable communication 
with the help of another user (the relay node). 

We further study the Partially Cooperative RBC with feedback, where, similarly as the relay 
channel with feedback Section V] , the outputs at user 2 are provided to user 1 and the outputs 
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at both users 1 and 2 are provided to the source ah through perfect feedback hnks. Our motivation 
to study this feedback channel is not only because feedback is a natural topic in the study of 
broadcast channels ^lElEEl and relay channels but also because study of feedback channels 
provides the insight on what information is useful for user cooperation. Furthermore, the proof of 
the converse for the capacity region of a feedback channel suggests a way to obtain a tighter outer 
bound than the cut-set bound on the capacity region for the corresponding relay broadcast channel 
without feedback. 



: Xi User 1 



Source X 




X2 ■■ I2 User 2 
Figure 2: Fully Cooperative Relay Broadcast Channel 



We then move on to study a more general model, the Fully Cooperative Relay Broadcast Channel, 
where both users can transmit cooperative information to each other through relay links (see 
Figure EJ. In this channel, both users can potentially gain in capacity due to this cooperative 
relaying, which will be demonstrated in the paper by a Gaussian example. We also study the 
Fully Cooperative RBC with feedback and derive results that are parallel to those for the Partially 
Cooperative RBC. 

For both the Partially Cooperative RBC and the Fully Cooperative RBC, we illustrate our results 
via two Gaussian cases. The first case is the D-AWGN Partially/Fully Cooperative RBC, where the 
outputs at the two receivers are corrupted by (physically) degraded Gaussian noise terms, i.e., if the 
random noise terms are denoted by Zi and Z2, then Z2 = Zi + Z' and Z\ and Z' are independent 
Gaussian random variables. Such degraded channel models are of information-theoretic interest, 
because we can usually establish the capacity regions for these models. Furthermore, the proofs 
of the converse for the capacity regions of these degraded models suggest techniques for obtaining 
outer bounds on the capacity regions of non-degraded Gaussian channels. The second Gaussian case 
being studied in this paper is the AWGN Partially/Fully Cooperative RBC, where the outputs at 
the two receivers are corrupted by independent Gaussian noise terms. This Gaussian case represents 
a natural channel encountered in practice. 

We note that a model of the broadcast channel with cooperating receivers has been introduced 
and studied in [^IIH]. This model differs from the Partially/Fully Cooperative RBC being studied 
in this paper in that the relay links for user cooperation are orthogonal to the original broadcast 
channel. We also note that a related relay broadcast channel model, where an additional relay node 
is introduced to broadcast systems to assist all users, has been introduced and studied in [2 H [29 ] . 

In the following, we summarize the main results of this paper. 

For the discrete memoryless Partially and Fully Cooperative RBCs: 

• We derive achievable rate regions, i.e., inner bounds on the capacity regions; 

• We provide outer bounds on the capacity regions, and show that these outer bounds 
are tighter than the cut-set bounds; 
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• We establish the capacity regions for the degraded Partially and Fully Cooperative 
RBCs, where the previous inner and outer bounds match; 

• We establish the capacity regions for the Partially and Fully Cooperative RBCs 
with feedback. We show that feedback does not increase the capacity regions for 

the degraded Partially and Fully Cooperative RBCs, but that it may improve the 
capacity regions for the non-degraded channels. In particTilar, feedback improves 
the capacity regions for the AWGN Partially and Fully Cooperative RBCs. 

For the Gaussian Partially and Fully Cooperative RBCs, we summarize our results in the following 
diagram, where C(-) denotes the capacity region and Tl{-) denotes the achievable rate region. We 
assume the Gaussian noise variance at user 1 is less than the Gaussian noise variance at user 2. 



C(D-AWGN Partially Cooperative RBC) 

= C(D-AWGN Partially Cooperative RBC with Feedback) 

= C(D-AWGN Fully Cooperative RBC) 

= C(D-AWGN Fully Cooperative RBC with Feedback) 



= 7^(AWGN Partially Cooperative RBC) 
C 7^(AWGN Fully Cooperative RBC) 



C(AWGN Partially Cooperative RBC with Feedback) 
= C(AWGN Fully Cooperative RBC with Feedback) 



The notation in this paper mainly follows the following rules. Upper case letters indicate random 
variables, and lower case letters indicate deterministic variables or realizations of the corresponding 
random variables. There are some exceptions, but these will be clarified where they appear in the 
paper. We use x or to indicate the vector (xi,...,x„), and use x" to indicate the vector 
{xi, . . . , Xn)- We define two functions: x := 1 — x and C{x) := ^ log(l + x). Throughout the paper, 
the logarithmic function is to the base 2. 

In the following sections, we first present the results for the Partially Cooperative RBC and the 
results for this channel with feedback. Wc then present the results for the Fully Cooperative RBC 
and the results for this channel with feedback. We finally discuss and compare the achievable 
regions for the AWGN case of these RBCs with all nodes being subject to a sum power constraint. 
We end the paper with some concluding remarks. 

2 Pcirtially Cooperative Relay Broadcast Channels 

In this section, we first introduce the channel model for the Partially Cooperative RBC, and then 
present the main results. We further illustrate the results via two Gaussian channel examples. 

2.1 System Model 

To define the Partially Cooperative RBC, wc use x to denote the source input, xi to denote the 
relay input of user 1, and yi and y2 to denote the outputs at user 1 and user 2, respectively. 
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DeBnition 1. A Partially Cooperative RBC consists of a channel input alphabet X , a relay in- 
put alphabet Xi, two channel output alphabets yi and 3^2; o,nd a probability transition function 
p{yi-,y2\x^xi) (see Figure\^. 

Note that the channel input-output relationship is similar to that of the standard relay channel 
0, but now the relay node (user 1) also has its own message to decode. We assume throughout 
the paper that the channel is memoryless. 
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Figure 3: Partially Cooperative Relay Broadcast Channel 



Definition 2. A (^2"-Ro ^2"-^^ ,2"-^'^ ,n) code for a Partially Cooperative RBC consists of: 

• Three message sets: Wo = {1, 2, ... , 2""^}, Wi = {1, 2, . . . , 2"-^i} and W2 = {1, 2, . . . , 2"-^2}; 

• An encoder: Wq x Wi x W2 X'^, which maps each message tuple {Wq, Wi, W2) to a codeword 

• A set of relay functions {fi}^^^ such that 

xi,i = fi{y 1,1, ■■■ ,yi,i-i), l<i<n; 

• Two decoders: one at user 1, Wq x Wi, which maps a received sequence to a message 
pair {Wq, Wi) € Wq x Wi; and the other at user 2, ~^ ^0 x "^2, which maps y'2 to a message 
pair {Wo,W2) G Wo X W2. 

We note that in the above definition, Wq indicates the common message that needs to be decoded 
at both users, and Wi and W2 are private messages that need to be decoded at users 1 and 2, 
respectively. 

The probability of error when the message tuple {Wq, Wi, W2) is sent is defined as 

Pi")(W^o, Wi, W2) = P {{Wo, Wi) ^ {Wo, Wi) or {W^, W2) / {Wo, W2)] , (1) 



and the average probability of error is defined by assuming that the message (Wo,VFi,VF2) is 
uniformly distributed over Wo x Wi x W2 and is given by 

^i"^ = 2nRo2nR.2nR^ ^^11 P^^^HWo , W„ W2) . (2) 

Wo=l Wi=l W2=l 

The rate tuple {Ro, Ri, R2) is said to be achievable for the Partially Cooperative RBC if there 
exists a sequence of (2"^° , 2"^^ , 2"^^ ^ j^) codes with average error probability Pe"'^ ^ as n goes 
to infinity. 
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Definition 3. A Partially Cooperative RBC is degraded if the transition probability satisfies 

p{yi,y2\x,xi) = p{yi\x,xi)p{y2\yi,xi). (3) 
i.e., y2 is independent of x, conditioned on yi and xi. 

2.2 Discrete Memoryless Partially Cooperative RBCs 

A motivation to study the Partially Cooperative RBC is that in many cases one user in the broadcast 
channel has the capability to decode at higher rate than the other user. Hence this user may also 
decode the message for the other user in addition to the message for itself, and then forward this 
information for the other user. The following achievable rate region for the Partially Cooperative 
RBC is based on this idea where the relay (user 1) employs the decode-and-forward relaying scheme 
to help user 2. 

Theorem 1. (Inner bound on Capacity Region for Partially Cooperative RBC) A rate tuple 
{Rq, Ri, R2) is achievable for the discrete memoryless Partially Cooperative RBC if 

Ro + R2< min {I{U, Xi;Y2), I{U; Yi [ Xi)}, 
Ri<I{X-Yi I U,Xi) 

for some joint distribution p(u,xi,x)p{yi,y2\x,xi), where U is bounded in cardinality by \U\ < 

\x\ ■ |;fi| + 2. 

Proof. See AppendixEIfor an outline of the proof. □ 

The achievable region based on the decode-and-forward scheme in TheoremHserves as an example 
to show that relaying from user 1 to user 2 indeed helps to enlarge the capacity region of the 
original broadcast channel. This will be further demonstrated by Gaussian channels later. More 
importantly, we will show that this achievable region is tight for the special case of degraded RBCs, 
and we hence derive the capacity region for the degraded Gaussian channel and feedback channel. 
Even for the non-degraded Gaussian channel, we will show that this achievable rate region is close 
to the outer bound on the capacity region. 

Other achievable regions can also be derived based on the relay node (user 1) using other relaying 
schemes to assist user 2, for example, the estimate-and-forward scheme, the amplify-and-forward 
scheme, or combinations of these schemes. The derivations of these achievable rate regions follow 
steps that are similar to those used in deriving the achievable rates based on these relaying schemes 
for the three-terminal relay channel as in . Which scheme results in the largest achievable rate 
region depends on the particular channel of interest. In general, none of these schemes provide a 
tight achievable rate region, i.e., the capacity region. Hence, rather than obtaining and comparing 
the achievable rate regions based on different relaying schemes for a given channel, deriving a 
relatively tight outer bound on the capacity region for the general channel model is more of interest 
to us. 

For the general discrete memoryless Partially Cooperative RBC, we provide the following outer 
bound on the capacity region. 

Theorem 2. (Outer bound on Capacity Region for Partially Cooperative RBC) The capacity region 
of the Partially Cooperative RBC is outer bounded by the region with the rate tuples {Rq, Ri, R2) 
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(4) 



satisfying 

Ro + R2< mill {I{U, Xi;Y2), I{U; H , Fa I ^i) } , 
Ri<I{X;Yi,Y2\U,Xi), 
Ro + Ri<I{U';Yi\Xi), 
R2<I{X;Yi,Y2\U',Xi) 

for some joint distribution p{u,u' , xi, x)p{yi,y2\x, xi) that satisfies two Markov chain conditions: 
Xi U ^ X and Xi U' ^ X . The auxiliary random variables U and U' are bounded in 
cardinality by \U\ < \X\ ■ \ + 2 and \U'\ < \X\ ■ \ + 2, respectively. 

Proof. See Appendix^ □ 

Remark 1. The outer bound given in Theorem\^ is tighter than the outer bound based on the 
general max-flow min-cut theorem ^6, Theorem 14-10.1] (the cut-set bound). 

To compare the two outer bounds, we first write the cut-set bound as follows: 

Ro + Ri<I(X;Yi\Xi) 

Ro + R2<I{X,Xi;Y2) (6) 
Ro + Ri + R2< IiX;YuY2\Xi) 

for some joint distribution p{x, xi)p{yi, y2\x, xi). 

We now show that the outer bound given in © in Theorem 21 is contained in (tighter than) the 
cut-set bound given in ©. 

In © , the bound on Rq + Ri implies 

Ro + Ri< I{U';Yi\Xi) = H{Yi\Xi) - H{Yi\U',X^) 
<H{Y,\Xi)-H{Yi\U',X,,X) 
= H{Yi\Xi)-H{Yi\Xi,X) 
= I{X-Yi\Xi) 

which is the first cut-set bound given in 
In ((2)), the bound on Rq + R2 based on the first term in the "min" implies 

Ro + R2< I{U,Xi-Y2) = H{Y2) - H{Y2\U,Xi) 
<H{Y2)-H{Y2\U,Xi,X) 
= HiY2)-H(Y2\Xi,X) 
= I{X,Xi;Y2) 

which is exactly the second cut-set bound given in ©• 

In we combine the bound on Rq + R2 based on the second term in the "min" with the bound 
on Ri and have 

Rq + Ri + R2< I{U- Yi,Y2\Xi) + I{X; Yi , Fa I U, Xi ) 

= I{U,X;YuY2\Xi) (9) 
= I{X;Yi,Y2\Xi) 



(7) 



(8) 
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where we have used the Markov property: U {Xi,X) (Yi, Y2) in the last equahty. The bound 
we have derived in the preceding equation is exactly the third cut-set bound given in ©. Therefore, 
we conclude that the outer bound given in Theorem [21 is tighter than the cut-set bound. 

The inner and outer bounds given in Theorems Qa-ndl^l may not be tight for the general Partially 
Cooperative RBC. However, for the degraded Partially Cooperative RBC, which satisfies the con- 
dition given in Definition |HJ we immediately see that the outer bound (bounds on Rq + R2 and Ri) 
given in Theorem [21 reduces to the form that matches the inner bound given in Theorem ^ Thus 
we have the following capacity region for the degraded Partially Cooperative RBC. 

Theorem 3. ( Capacity Region for Degraded Partially Cooperative RBC) For the degraded Partially 
Cooperative RBC, which satisfies the condition given in Definition\^ the capacity region is given 
by the region with the rate tuples (Rq, Ri, R2) satisfying 

Ro + R2 < mm {I {U,Xi;Y2), I {U;Y^ | Xi)}, 
Ri<I{X-Yi\U,Xi) 

for some joint distribution p{xi)p{u\xi)p{x\u)p{yi,y2\x,xi), where U is bounded in cardinality by 
\U\ < \X\ ■ \ + 2. Two Markov chains are implied in the joint distribution: Xi ^ U X and 
U^{Xi,X) ^ {Yi,Y2). 



Proof. The achievability is given by Theorem^ The converse part can be easily derived from the 
outer bound for general Partially Cooperative RBCs given in Theorem [21 and a sketch of the proof 
is given in Appendix [0 □ 

Remark 2. The bounds on Rq + Ri and on R2 given in Theorem\^are not useful for the degraded 
channel. They are still useful for the non-degraded channels as we will demonstrate in the following 
subsection via the AWCN Partially Cooperative RBC. 



2.3 Gaussian Partially Cooperative RBCs 

We study two Gaussian Partially Cooperative RBCs, where the outputs at the two users are 
corrupted by additive white Gaussian noises. 

We first define what it means for one Gaussian noise variable to be degraded with respect to 
another, and then define the two Gaussian Partially Cooperative RBCs with degraded noise terms 
and independent noise terms, respectively. 

DeRnition 4. The zero mean Caussian random variable Z2 is (physically) degraded with respect 
to the zero mean Caussian random variable Z\ if Z2 can be expressed as Z2 = Zi + Z' , where Z' is 
a zero mean Caussian random variable that is independent of Z\ . 

DeGnition 5. The D-AWCN Partially Cooperative RBC is a Partially Cooperative RBC with the 
channel outputs being corrupted by degraded Caussian noise terms, i.e., the channel outputs at the 
two users are given by 

Yi = X + Zi 

(11) 

Y2 = X + Xi + Zi + Z' ^ ^ 

where Z\ and Z' are independent zero mean real Caussian random variables with variances Ni and 
N2 — Ni, respectively, where Ni < The channel input sequences and {xi^n} oltg subject to 
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the average power constraints P and Pi, respectively, i.e.. 



^ n 1 " 

-J2'^^<P, and -E^i^^i- (12) 

i=l i=l 

Definition 6. The AWGN Partially Cooperative RBC is the Partially Cooperative RBC with the 
channel outputs being corrupted by independent Caussian noise terms, i.e., the channel outputs at 
the two users are given by 

Yi = X + Zi 

(13) 

Y2 = X + Xi + Z2 ^ ' 

where Z\ and Z2 are independent zero mean real Caussian random variables with variances Ni and 
N2, respectively, where Ni < N2. The channel input sequences and are subject to the 

power constraints given in (fT^ . 



Note that the D-AWGN Partially Cooperative RBC is degraded (satisfies the condition given 
in Definition ^ due to the degraded Gaussian noise terms at the two outputs. For the D-AWGN 
Partially Cooperative RBC, we have the following theorem for the capacity region. 

Theorem 4. (Capacity Region for D-AWCN Partially Cooperative RBC) The capacity region for 
the D-AWCN cooperative RBC is given by the region with the rate tuples {Rq, Ri, R2) satisfying 

0</3<i I \ aP + N2 

-<'^(f) 

for some a € [0, 1], where a := 1 — a, (3 := 1 — (3 and C{x) := ^ log(l + x) as defined at the end of 
Section^ 



In (|14j) , the parameter a indicates the fraction of source power that is used to transmit information 
intended for user 1, and /3 is the correlation coefficient between the source and relay signals. 



Proof. The proof of the achievability follows by evaluating the mutual information terms in Theorem 
□ using the following input distributions: Xi ~ A^(0,Pi), U' - N{0,(3aP), X' ~ N{0,aP), where 

Xi, U', X' are independent. Furthermore, we let U = ^J~^Xi + U' and X = U + X' . 

The proof of the converse follows directly from the proof of the converse for the D-AWGN Partially 
Cooperative RBC with feedback (proof given in Appendix^l), because the feedback channel provides 
an outer bound on the capacity region for the original channel without feedback. □ 



We now study the property of the boundary of the capacity region for the D-AWGN Partially Co- 
operative RBC. In the following discussion, we let i?o = for convenience. In dJ), the optimization 
over (3 can be evaluated by considering the following two cases. 

Case 1: If jV2-Vi — then {3 = 1 achieves the maximum in (|14|) for any a G [0, 1], and the 
capacity region is defined by the rate pairs {Ri, R2) that satisfy 
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Note that in this case Ri + R2 < C y^j, and hence the boundary of the capacity region is a 
straight line. The capacity region for the D-AWGN Partially Cooperative RBC hence coincides 
with the capacity region of a broadcast channel where the two users have symmetric channels (both 
have noise levels A'^i). This means that if the relay power is large enough, user 2 effectively sees the 
same level of noise as user 1 due to relaying. Also note that the value is a threshold on 

Pi beyond which the capacity region will not be further enhanced by relaying. 



Case 2: If j^^^j^^ < then define oq := pf ^ • '^^^ optimizing (3 will depend on the 
value of a compared to oq. 

(i) If a > ao, then (3 = 1 achieves the maximum in ()14() and again the rate pair given in 1)15(1 
defines one part of the boundary of the capacity region corresponding to i?i > C {^^^ ■ It is clear 
that this part of the boundary is straight line. 

(ii) If < a < then (3* that achieves the maximum satisfies the following equation: 

( P^ + aP + 2Vf3aPPi \ ^( /3aP \ 

^[ ^^pTn, j=H^^^^J- ^''^ 

Hence the other part of the boundary of the capacity region corresponding to < i?i < ^^^^ is 
defined by the rate pairs {Ri, R2) that satisfy 



We summarize the properties of the boundary of the capacity region in the following proposition. 
Pi > _P 

N2-N1 — Ni ■ 



Proposition 1. If ^ > the boundary of the capacity region for the D-AWGN Partially 



Cooperative RBC is a straight line defined by ((15|) . // < the boundary of the capacity 

region for the D-AWCN Partially Cooperative RBC consists of one straight line segment defined by 

(fT5|) . where Ri > C (^^nt) ' "^'^ '^''^^ curved segment defined by (fT7]). where < Ri < (^ivf" 

We now compare the capacity region for the D-AWGN Partially Cooperative RBC with the 
capacity region for the Gaussian broadcast channel without user cooperation. The capacity region 
of the latter channel is given by ^ Chapter 14.6] 

for some a E [0,1]. In Figure 0J we plot this region with the dashed curve as its boundary. We 
also plot the capacity regions (boundaries with solid lines) for the D-AWGN Partially Cooperative 
RBC under different relay SNR's Note that for simplicity, we only plot the region for the case 
where Rq = 0. It is clear from the figure that the D-AWGN Partially Cooperative RBC has a 
larger capacity region, and the improvement becomes more significant as ^ increases. However, as 
suggested by discussion under Case 1, no further improvement is possible for values of ^ greater 
than 14.54 dB. Thus the outer most solid line with ^ = 15dB defines the best capacity region. 

We now consider the AWGN Partially Cooperative RBC defined in Definition 1^1 where the noise 
terms at the two outputs are independent. This channel does not satisfy the degradedness condition 
given in Definition |31 An achievable rate region for this channel can be derived, which is exactly 
the same as the capacity region for the D-AWGN Partially Cooperative RBC. 
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Figure 4: Comparison of the capacity regions for the Gaussian broadcast channel and the D-AWGN 
Partially Cooperative RBCs. 



Corollary 1. (Inner bound on Capacity Region for AW GN Partially Cooperative RBC) An achiev- 
able rate region for the AWCN Partially Cooperative RBC is given by the capacity region for the 
D- AW CN Partially Cooperative RBC given in Theorem^ Hence the boundary of this achievable 
rate region has the properties described in Proposition^ 

The proof follows the steps that are same as in the achievability proof for Theorem |2 

The achievable region given in Corollary ^ may not be a tight inner bound on the capacity region 
for the AWGN Partially Cooperative RBC. In the following, we further provide an outer bound on 
the capacity region for this channel. 

Theorem 5. (Outer bound on Capacity Region for AWGN Partially Cooperative RBC) The ca- 
pacity region for the AWGN Partially Cooperative RBC is outer bounded by the rate region with 
rate tuples {Rq, Ri, R2) satisfying: 




Pi + aP + 2y/paPPi \ ( paP 



aP + N2 r \aP + / ' 

I z y y u-i -r jVi+A^a / J 

. N1+N2 J 

'aP + paP' 



Rq + Ri < C ^ 

iVi 

for some a € [0, 1] and [3 G [0, 1], where a := 1 — a, (3 := \ — [3 and C{x) := ^ log(l + x) as defined 
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at the end of Section^\ 



Proof. The proof is relegated to Appendix El since part of the proof is similar to the proof of 
Theorem |7| given in Appendix El D 

In Figure El we plot the inner bound on the capacity region (achievable region) of the AWGN 
Partially Cooperative RBC with dot-dashed line as its boundary and the outer bound on the 
capacity region with the solid line as its boundary. We plot the region for the case where Rq = 
for simplicity. It is clear from the figure that the outer and inner bounds are very close. The gap 
between the two bounds varies with the particular SNRs chosen for the transmission links in the 
system, and in general is small. In FigureEl we also plot the capacity region of the original broadcast 
channel with dashed line as its boundary. It is clear that the AWGN Partially Cooperative RBC 
has a significantly larger capacity region than the broadcast channel. 

2.5 1 > > > > > 1 




R1 (bps/Hz) 

Figure 5: Inner and outer bounds on the capacity region of the AWGN Partially Cooperative RBC. 



Remark 3. For the AWGN Partially Cooperative RBC, we have restricted our attention to the 
channel where Ni < N2, i.e., the channel from the source to the relay (user 1) is stronger than the 
channel from the source to user 2. This is a case for which it is reasonable to introduce a relay 
transmission from user 1 to user 2. Nevertheless, even if the relay (user 1) has a weaker channel 
from the source than user 2, i.e., Ni > N2, it can still assist user 2. However, under this condition, 
the relay needs to use schemes other than the decode- and- forward scheme. For example, the relay 
can employ the estimate- and- forward scheme to assist user 2, and an achievable rate region based 
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on this scheme is given as follows: 

Rn + RT < mill IC ( ^^^] X ( -rrr^^^) \ , 1 

(20) 



0<a<l,0<r)<l ^ \ N2 ^ riPiNi+aP{Ni+N2)+NiN2 

R is clear that the above achievable region is larger than the capacity region of the original broadcast 
channel. This achievable rate region can be viewed as a special case of the region given in Theorem 
\14[ with the roles of user 1 and user 2 being switched and the corresponding notations for rates and 
noise variances also being switched. 



3 Partially Cooperative RBCs with Feedback 

In this section, we study the Partially Cooperative RBC with feedback, where the outputs at user 
2 are provided to user 1 and the outputs at both users 1 and 2 are provided to the source all 
through perfect feedback links (see Figure 6). Note that this definition for feedback channel follows 
the definition for the relay channel with feedback (5', Section V]. We will show that feedback in 
general may improve the capacity region for the Partially Cooperative RBCs, but does not affect 
the capacity region for the degraded Partially Cooperative RBCs. 



Y^i,...,Yi 



n-l 



Wo 
Wi 

W2 



Encoder 



-y-n 

Channel r^i 



yn 



Relay 
Encoder 



Decoder 1 



n—1 



Decoder 2 



Wo,W2 



^2,1, • • • , ^2,n-l 



Figure 6: Partially Cooperative RBC with feedback 



For a distribution on the message set p{wo, wi,W2), the following joint distribution is induced for 
a Partially Cooperative RBC with feedback: 

p{wo,wi,W2,x'^, x", , y2 ) 

" (21) 
= p{wo,wi,W2)Y[pixi\wo,wi,W2,y\'^,y2~^)p{xi^i\y\'^,y2~^)p{yi^i,y2,i^^^^ 

i=l 

3.1 Discrete Memoryless Partially Cooperative RBCs with Feedback 

From the definition for the degraded Partially Cooperative RBC given in Definition |3J it is clear 
that the Partially Cooperative RBC with feedback is degraded. For this channel, we have the 
following capacity theorem. 
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Theorem 6. (Capacity Region for Partially Cooperative RBC with Feedback) The capacity region 
of the Partially Cooperative RBC with Feedback is given by the rate region with the rate tuples 
{Rq, Ri, R2) satisfying 

Ro + R2<mm{l{U,Xi;Y2),IiU;Y,,Y2\X,)}, 
Ri<I{X;Yi,Y2\U,Xi) 

for some joint distribution p(xi)p{u\xi)p{x\u)p{yi,y2\x,xi), where U is bounded in cardinality by 
\U\ < \X\ ■ l-^il + 2. 

Proof. Theorem n provides the achievabiUty with (Yi, Y2) replacing Yi as the output at user 1. The 
proof of the converse follows steps that are similar to those in the proof for Theorem [21 and is hence 
only outlined in Appendix O D 

Remark 4. From the above achievabiUty proof, it is clear that in the capacity region achieving 
scheme, the source does not exploit the feedback information from the two users. However, the 
relay (user 1) makes use of the feedback information from user 2 to improve on its decoding and 
relaying. 

It is clear that if the original Partially Cooperative RBC is degraded, then the capacity region 
given in Theorem]^ is the same as the capacity region for the original channel without feedback. 

Corollary 2. Feedback does not increase the capacity region for the degraded Partially Cooperative 
RBCs. 

This result is intuitive. Since the original channel is degraded, the output y2 at user 2 does not 
provide user 1 with more information other than the information already contained in the output 
yi at user 1. Hence feedback of 2/2 to user 1 does not help. The reason that feedback of yi and 
2/2 to the source does not help follows from the result in 1(^ that feedback does not increase the 
capacity for the physically degraded broadcast channel. 



3.2 Gaussian Partially Cooperative RBCs with Feedback 

In this section, we consider two Gaussian feedback channels: the D-AWGN Partially Cooperative 
RBC with feedback and the AWGN Partially Cooperative RBC with feedback. We study how 
feedback affects the capacity regions of these Gaussian channels. 

For the D-AWGN Partially Cooperative RBC with feedback, we have the following theorem, 
which is consistent with the result given in Corollary [21 for the discrete memoryless channels. 

Theorem 7. (Capacity Region for D-AWGN Partially Cooperative RBC with Feedback) Feedback 
does not increase the capacity region for the D-AWGN Partially Cooperative RBC, i.e., the capacity 
region for the D-AWGN Partially Cooperative RBC with feedback is the same as the capacity region 
for the D-AWGN Partially Cooperative RBC without feedback given in Theorem^ 

Proof. The achievability proof is same as that for the D-AWGN Partially Cooperative RBC. The 
proof for the converse is provided in Appendix El D 
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We note that in the definition for the D-AWGN Partially Cooperative RBC, the output yi at user 
1 is not affected by the input signal xi transmitted by user 1 to user 2. In practice, xi may cause 
interference to yi. We hence define the following Self- Interfered D-AWGN Partially Cooperative 
RBC model: 

ll = X + aA-. + Z, 

Y2= X + Xl+ Zl + Z' ^ ^ 

where a is a real constant number indicating how strong the interference is, and Zi and Z' are 
independent zero mean real Gaussian random variables with variances A^i and N2 — N1, respectively. 

The Self-Interfered D-AWGN Partially Cooperative RBC is degraded. It is also easy to check 
that the self-interference does not aff'ect the capacity region of the D-AWGN Partially Cooperative 
RBC with/without feedback. This result is summarized in the following corollary, and it will be 
useful in proving the capacity region for the AWGN Partially Cooperative RBC with feedback given 
in Theorem IHl 

Corollary 3. The capacity region for the Self- Interfered D-AWGN Partially Cooperative RBC 
with/without feedback is the same as the capacity region for the D-AWGN Partially Cooperative 
RBC with /without feedback, and is given in Theorem^ 

We now consider the second Gaussian feedback channel: the AWGN Partially Cooperative RBC 
with feedback. For this channel, we have the following capacity theorem. 

Theorem 8. ( Capacity Region for AWGN Partially Cooperative RBC with Feedback) The capacity 
region for the AWGN Partially Cooperative RBC with feedback is given by 



Ro + R2 < max min Ic ( "'^J" ^ ^""^-^^ | , C [ ^"'^ 



aP 

N1N2 
N1+N2 



(24) 



Ri<C 
for some a G [0, 1] . 

Proof. The idea of the proof is to follow the argument in (36i Chapter 3.2.2] to change the AWGN 
Partially Cooperative RBC with feedback to an equivalent D-AWGN Partially Cooperative RBC 
with feedback, with A''i being replaced by j^^^^. 

We first define 

N,Y2 + N2Yi 

' = N,+N2 ^''^ 
and note that the mapping from (Yi,Y2) to (5", 1^2) is one-to-one. Hence the channel with the 
outputs being (Yi,l2) and Y2 is equivalent to the channel with the outputs being (S*, I2) and 12- 

We now want to show that given {S,Xi), Y2 is independent of X, i.e., Y2 is a degraded version 
of S. We express S in the following form: 

where Zi := ^^^^1^^^^ ■ We can express Y2 as 
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where Z:=^^(Z2-Zi). 

It is clear that Z is independent of X and X\ , and it is easy to check that Z is independent of 
Z\. Hence Z is independent of S. Therefore, given (S*, Xi), I2 is independent of X. 

Now, for the equivalent channel with outputs being (£',12) and Y^^ we have 

N^ 

S = X^ — Xi + Zi 

iVi+A^2 (28) 



Fa = X + + Zi + Z 



where Zi and Z are independent zero mean real Gaussian random variables with variances j^^^^^ 
and ^v^^, respectively. 

This is a Self-Interfered D-AWGN Partially Cooperative RBC with feedback, and hence Corollary 
121 can be applied to obtain the capacity region. □ 

Corollary 4. Feedback enlarges the capacity region for the AWGN Partially Cooperative RBC. 



This corollary can be shown by comparing the capacity region of the AWGN Partially Cooperative 
RBC with feedback given in Theorem |H1 with the outer bound on the capacity region of the AWGN 
Partially Cooperative RBC given in Theorem |SJ This result is reasonable because for the AWGN 
Partially Cooperative RBC, the output y2 at user 2 is not a degraded version of the output yi at 
user 1 , and hence feedback of y2 to user 1 provides further information and results in an enlargement 
of the capacity region. 



3.3 Comparison with Results on Broadcast Channels with Feedback 

At this point, it is instructive to compare the results on the capacity regions for broadcast chan- 
nels with feedback (see |1] for a review) with our results on the capacity regions of the Partially 
Cooperative RBCs with feedback. 

We have obtained the capacity region of the general discrete memoryless Partially Cooperative 
RBC with feedback in Theorem El However, the capacity region is still not known for the general 
discrete memoryless broadcast channel with feedback. We have shown that feedback does not 
enlarge the capacity region for the degraded Partially Cooperative RBC and its Gaussian example 
in Corollary [21 and Theorem [71 This result is consistent with the result obtained in jlUl lllj that 
feedback does not enlarge the capacity region for the physically degraded broadcast channel. 

We have obtained the capacity region of the AWGN Partially Cooperative RBC with feedback 
in Theorem [HI However, the capacity region of the AWGN broadcast channel with feedback is still 
not known. We have shown that feedback enlarges the capacity region for the AWGN Partially 
Cooperative RBC. This is consistent with the result in [3ZI that feedback enlarges the capacity 
region for the AWGN broadcast channel. However, the reasons for the enlargement are different for 
the two channels. For the AWGN Partially Cooperative RBC with feedback, the source does not 
make use of the feedback information. It is user 1 that utilizes the feedback information from user 
2 to improve on its decoding and relaying. Such a strategy achieves the capacity region. Whereas 
for the broadcast channel with feedback, the source needs to make use of the feedback information 
to improve the encoding. In (371, the authors provided an example encoding scheme for the source 
to exploit feedback information to improve the capacity region. However, the optimal encoding 
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scheme that achieves the capacity region for the AWGN broadcast channel with feedback is still 
not known. 

We finally note that the structure of feedback in Partially Cooperative RBCs is different from 
that in broadcast channels. In Partially Cooperative RBCs with feedback, the output at user 2 
is also fed back to user 1, but this feedback is not available in broadcast channels with feedback. 
Hence obtaining the capacity region for the Partially Cooperative RBCs with feedback does not 
necessarily imply obtaining the capacity region for the broadcast channel with feedback. 

4 Fully Cooperative Relay Broadcast Channels 

In the previous sections, we studied the Partially Cooperative RBC where one user (usually the 
user with "better channel" from the source) in the broadcast system helps the other user by sending 
relay signals. In this case, we have seen that the Partially Cooperative RBC has a larger capacity 
region than the original broadcast channel due to user cooperation. It is then natural to explore 
whether the capacity region can be further enlarged if we allow both users to help each other by 
sending cooperative signals through relay links. 

In this section, we study the Fully Cooperative RBC, where not only user 1 serves as a relay 
to help user 2, but user 2 serves as a relay to assist user 1 as well. We will first describe the 
channel model, and then present our main results. We further illustrate the results on achievable 
rate/capacity regions via Gaussian examples, and compare these regions with those of the Partially 
Cooperative RBC. 

4.1 System Model 

We use X to denote the source input, xi and X2 to denote the relay inputs from users 1 and 2, 
respectively, and yi and y2 to denote the outputs at users 1 and 2, respectively. 

Definition 7. A Fully Cooperative RBC consists of a channel input alphabet X , two relay input 
alphabets Xi and X2, two channel output alphabets and and a probability transition function 
p{yi-,y2\x^xi,X2) (see Figure^. 

Definition 8. A Fully Cooperative RBC is degraded if it either satisfies the condition 

P{yi,y2\x,Xi,X2) =piyi\x,Xi,X2)p{y2\yi,Xi,X2), (29) 

i.e., y2 is independent of x, conditioned on yi, xi and X2; or satisfies the condition 

p{yi,y2\x,xi,X2) =p{y2\x,xi,X2)p{yi\y2,xi,X2), (30) 
i.e., yi is independent of x, conditioned on y2, xi and X2. 

Without loss of generality, in this paper we only considers the degraded channel that satisfies the 
first condition. 

The definition for a (2"^o,2"'f^i,2"'f^2 n) code for the Fully Cooperative RBC is similar to that 
for the Partially Cooperative RBC, except that it includes another set of relay functions {s'il^Li 
such that 

X2,i = gi{y2,i,---,y2,i-i), i<i<n. (31) 
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Figure 7: Fully Cooperative Relay Broadcast Channel 
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4.2 Discrete Memoryless Fully Cooperative RBCs 

To derive an achievable rate region for the Fully Cooperative RBC, we first need to choose relaying 
schemes for user 1 and user 2 to assist each other. A simple choice is one where one of the users 
employs the decode-and-forward scheme, and the other user always sends a single codeword (that 
may vary according to the target rate tuple) which results in the best achievable rate region. We 
obtain the following achievable rate region which is the union of two achievable rate regions derived 
by switching these two relaying schemes for the two users. 

Theorem 9. (Inner bound on Capacity Region for Fully Cooperative RBC) An achievable rate 
region for the Fully Cooperative RBC is the convex hull of the union of the following two rate 
regions IZi and IZ2 : 



II J.p p p^ i?o + i?2 <min {/([/, Xi;y2|X2),I(t/; Yi|Xi,X2)}, \ 
U |(^o,i?i,i?2): R^^i^x-Y,\U,Xr,X2) ] 



p{u,x-i,X2,x) 



1? II /rp R Ro + Ri<mm{l{U',X2;Yi\Xi),I{U';Y2\Xi,X2)}, 

U [iRo,Ri,R2): R^^j^X;Y2\U',X^,X2) 



(33) 



p{u' ,Xl,X2,x) 



where U and U' are bounded in cardinality by \U\ < \X\ ■ \Xi\ ■ \X2\ + 2 and \hl'\ < \X\ ■ \Xi\ ■ \X2\ + 2, 
respectively. 

The proof is similar to the proof for Theorem ^ and is omitted. 

The achievable rate region given in Theorem |2l will be shown to be tight for the degraded Fully 
Cooperative RBC in Theorem 1121 However, this achievable rate region may not be tight for a 
general Fully Cooperative RBC. For example, for the AWGN Fully Cooperative RBC which we 
will consider later, this achievable rate region is not tight, and the relay node that sends a single 
codeword does not help at all. This relay needs to employ a better relaying scheme, for example, the 
estimate-and-forward scheme ^ Theorem 6], to be of help. Hence, motivated by the AWGN Fully 
Cooperative RBC, we provide the following achievable rate region which is based on the scheme 
where one user in the system employs the decode-and-forward scheme and the other user in the 
system employs the estimate-and-forward scheme to relay information. 

Theorem 10. (Inner bound on Capacity Region for Fully Cooperative RBC) An achievable rate 
region for the Fully Cooperative RBC is the convex hull of the union of the following two rate regions 
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TZi and 7^2 

U 

p{x2)p{u,Xi,x) 

piyi,y2\x,xi,x2) 

P{y2\y2,Xl,X2,u) 



Ro + R2< mill {l{U,Xi;Y2\X2),I{U;Y^\Xi)}, 

Ri<IiX;Y2,Yi\U,Xi,X2) 
{Ro,Ri,R2). ^^^.^^^ 

I{X2 ■,Yi\U,Xi)> !{% ■,Y2\Yi,U,Xi,X2) 



(34) 



u 

p{xi)p{u' ,X2,X) 

p{yi,y2\x,xi,x2) 
p{yi\yuxi,x2,u') 



R^ + Ri<mm{l{U',X2;Yi\Xi),I{U';Y2\X2)], 

R2<I{X;YuY2\U',XuX2) 
{Ro,Ri,R2). ^^^.^^^ 

I{Xr,Y2\U',X2)>I{Yr,Yi\Y2,U\Xi,X2) 



Proof. See Appendix O for an outline of the proof. 



(35) 
□ 



The achievable rate region given in Theorem serves as an example to demonstrate that the 
Fully Cooperative RBC can achieve larger rate region than the Partially Cooperative RBC due 
to an additional relay link. This will be clear when we apply Theorem to the AWGN Fully 
Cooperative RBC in the next subsection. 

There are other relaying schemes that the system can choose for the two users to assist each 
other, and each of these relaying schemes results in an achievable rate region. In general, these 
achievable regions are not tight. As we have remarked for the Partially Cooperative RBC, we will 
focus on deriving an outer bound on the capacity region instead of providing all the achievable 
regions that we can think of. 

In the following theorem, we provide an outer bound on the capacity region for the Fully Co- 
operative RBC. Note that this outer bound is tighter than the outer bound given by the cut-set 
bound. 

Theorem 11. (Outer bound on Capacity Region for Fully Cooperative RBC) The capacity region 
for the Fully Cooperative RBC is outer bounded by the rate region with the rate tuples {Rq, Ri, R2) 
satisfying: 

Ro + R2<uim{l{U,Xr,Y2\X2),I{U;Yi,Y2\Xi,X2)}, 
Ri<I{X;Yi,Y2\U,Xi,X2), 

Ro + Ri<mm{l{U',X2;Yi\Xi),I{U';Yi,Y2\Xi,X2)}, 
R2<I{X;Yi,Y2\U',Xi,X2) 



(36) 



for the joint distribution p{u, u' , xi, X2, x)p{yi,y2\xi, X2, x) that satisfies the Markov chains: (Xi, X2) 
U ^ X and {Xi,X2) U' ^ X . Furthermore, the auxiliary random variables U and U' are 
bounded in cardinality by \U\ < \X\ ■ \Xi \ ■ \X2\ + 2 and \W\ < \X\ ■ \Xi \ ■ \X2\ + 2, respectively. 

The proof for Theorem 1111 is similar to the proof for Theorem |21 and hence is omitted. 



For the special case of the degraded Fully Cooperative RBC, we have the following capacity 
theorem. 
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Theorem 12. (Capacity Region for Degraded Fully Cooperative RBC) The capacity region for the 
degraded Fully Cooperative RBC that satisfies the condition ()29() is given by 



, I r i?o + i?2 <min{/(^7,Xi;y2|X2),/([/;yilXi,X2)}, \ 



(37) 



p{xx,X2,u)p{x\u) 

where U is bounded in cardinality by \U\ < \X\ ■ \Xi \ ■ \X2\ +2. 



Proof. The achievability is given by Theorem |21 The converse proof follows by applying the de- 
graded condition (|^^ to the first two bounds given in Theorem ITTl □ 

Note that for the degraded Fully Cooperative RBC, the output at user 2 is a degraded version of 
the output at user 1, and it does not receive any more information than user 1. Hence user 2 does 
not need to relay any information for user 1, and all it does is to send a single codeword (may vary 
according to the target rate tuple) which results in the best achievable rate region. The converse 
for Theorem 1121 shows that this scheme is optimal. 



4.3 Gaussian Fully Cooperative RBCs 



As for the Partially Cooperative RBC, we study two Gaussian channels for the Fully Cooperative 
RBC: the D-AWGN and the AWGN Fully Cooperative RBCs. 

For the D-AWGN Fully Cooperative RBC, the channel outputs at the two users are given by 

Yi = X + X, + Z, 

Y2 = X + Xi + Zi + Z' ^ ' 

where Zi and Z' are independent zero mean real Gaussian random variables with variances A^i and 
N2 — Ni, respectively, where A''i < N2. The channel input sequences {xi^n} and {x2,n} are 

subject to the average power constraints P, Pi and P2, respectively, i.e., 

^ n 1 " \ ^ 

-^xHp, -Y.xl,<Pi, and -Y,4,i<P2. (39) 

i=l i=l 1=1 



Note that the D-AWGN Fully Cooperative RBC satisfies condition (|29jl . and is hence degraded. 
The following theorem provides the capacity region for the D-AWGN Fully Cooperative RBC. 

Theorem 13. (Capacity Region for D-AWGN Fully Cooperative RBC) The capacity region for the 
D-AWCN Fully Cooperative RBC is the same as the capacity region for the D-AWGN Partially 
Cooperative RBC given in Theorem^ 



Proof. The proof of the achievability is straightforward based on the proof of the achievability for 
the Partially Cooperative RBC with user 2 being silent. The proof of the converse follows similarly 
as the proof of the converse for Theorem [Tj □ 

Remark 5. The relay link from user 2 to user 1 does not help to enlarge the capacity region for 
the D-AWGN Fully Cooperative RBC 
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The intuition behind Theorem is as fohows. For the D-AWGN Fully Cooperative RBC, 
user 2 receives a degraded version of the output at user 1, and hence can not provide further 
information for user 1 other than the information that user 1 already knows. This result is also 
consistent with Theorem [7| that feedback does not increase the capacity region for the D-AWGN 
Partially Cooperative RBC, i.e., perfectly providing the output at user 2 to user 1 cannot enlarge 
the capacity region for the D-AWGN Partially Cooperative RBC. It is then reasonable that sending 
information based on the output at user 2 to user 1 through a noisy channel cannot enlarge the 
capacity region for the D-AWGN Partially Cooperative RBC. This is exactly what Theorem lli^l 
concludes. 

However, Theorem^] is not necessarily true for the discrete memory less degraded Fully Coop- 
erative RBC. First of all, it is clear that the Fully Cooperative RBC achieves at least the capacity 
region for the corresponding Partially Cooperative RBC with user 2 "being silent" (sending a fixed 
alphabet symbol). We now explore whether the degraded Fully Cooperative RBC can achieve a 
better rate region. Although for the discrete memoryless degraded Fully Cooperative RBC, user 2 
still cannot provide further information to user 1 through the relay link, it can affect the channel by 
sending a predetermined codeword (this is not the case for the D-AWGN Fully Cooperative RBC, 
because the channel is determined by the Gaussian noises and is independent of the input). Hence 
user 2 can send a single codeword through the relay link to result in the best achievable region. 
Therefore, the relay link from user 2 to user 1 can potentially assist in enlarging the capacity region 
for the discrete memoryless Partially Cooperative RBC. 

We now consider the AWGN Fully Cooperative RBC where the Gaussian noise terms at the two 
receivers are independent. For this channel, the outputs at the two users are given by 



where Z\ and Z2 are independent zero mean real Gaussian random variables with variances A'^i and 
N2-, respectively, where A^i < N^- The channel input sequences {x„}, {x\^n\ and {x2,n} are subject 
to the power constraints given in (|39)) . 

It is clear that the AWGN Fully Cooperative RBC can achieve the rate region of the AWGN 
Partially Cooperative RBC given in Corollary ^ by using the same coding scheme and keeping user 
2 silent. Can it achieve a better rate region? Since the outputs at user 1 and user 2 are corrupted 
by stochastically independent noise terms, user 2 indeed receives some additional information other 
than the information received at user 1. Hence potentially user 2 can assist in enlarging the rate 
for user 1 by sending this additional information to user 1 through the relay link. Although user 2 
cannot decode this additional information (receiver noise level at user 2 is higher than that at user 
1), it can first compress this information and then forward it to user 1, i.e., user 2 can employ the 
estimate-and-forward relaying scheme. 

We provide an achievable rate region for the AWGN Fully Cooperative RBC based on user 1 
employing the decode-and-forward relaying scheme and user 2 employing the estimate-and-forward 
relaying scheme in the following theorem. 

Theorem 14. (Inner bound for AWGN Fully Cooperative RBC) An achievable rate region for the 
AWGN Fully Cooperative RBC is the convex hull of the rate tuples {Rq, Ri, R2) that satisfy 



Yi = X + X2 + Zi 
Y2 = X + Xi + Z2 



(40) 




) 



C 



( 



aP + 7?P2 + Ni 



l3aP 



) 



(41) 



21 



for some a € [0, 1] and r] G [0, 1]. 



Proof. See Appendix IHl 



□ 



Note that the parameter rj in (|41() is the fraction of the relay power at user 2 being used for relaying 
transmission. This parameter can be used to tradeoff between the rates R2 and Ri. Enlarging r] 
sacrifices R2 to improve Ri. This is because larger r] causes more interference to user 1 in the 
decoding of the information for user 2, and hence user 1 becomes less helpful for user 2. On the 
other hand, user 1 gets more benefit from user 2 due to the larger relaying power. 



Remark 6. Theorem \14\ shows that the AWGN Fully Cooperative RBC indeed achieves a larger 
rate region than the AWGN Partially Cooperative RBC. This is because the relay link from user 
2 to user 1 assists in enlarging the rate region. Theorem \14\ also shows that the AWGN Fully 
Cooperative RBC achieves a larger rate region than the D-AWGN Fully Cooperative RBC. These 
two facts will be demonstrated by the numerical results at the end of this section. 



We further provide an outer bound on the capacity region for the AWGN Fully Cooperative RBC. 

Theorem 15. (Outer bound on Capacity Region for AWGN Fully Cooperative RBC) The capacity 
region for the AWGN Fully Cooperative RBC is outer bounded by the rate region with rate tuples 
{Rq , i?i , i?2 ) satisfying 



(5aP 



aP + N2 



aP + 



N1N2 
N1+N2 



Ri<C 



aP 

N1N2 
N1+N2 



j{aP + paP) 



j{aP + paP) + ^^ 




(42) 



N1N2 



R2<C 



j{aP + PaP) 



N1N2 
N1+N2 



for some a, /3, 7 E [0, 1] . 



Proof. See Appendix ^ 



□ 



We now compare the achievable rate region for the AWGN Fully Cooperative RBC with the 
capacity region for the D-AWGN Fully/Partially Cooperative RBC numerically. In Figure El we 
plot the inner bound (boundary with solid line) and outer bound (boundary with circled line) 
on the capacity region for the AWGN Fully Cooperative RBC, the capacity region (boundary 
with dot-dashed line) for the D-AWGN Fully/Partially Cooperative RBC, and the capacity region 
(boundary with dashed line) of the original Gaussian broadcast channel without relay links. Since 
the capacity region of the AWGN Fully Cooperative RBC lies between its inner and outer bounds, 
it is clear from the figure that this capacity region is larger than the capacity region of the D-AWGN 
Fully /Partially Cooperative RBC. 

In FigurelHl we also plot the achievable region for the AWGN Partially Cooperative RBC (bound- 
ary also with dot-dashed line). It is clear from the figure that the achievable region for the AWGN 
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Fully Cooperative RBC is larger than the achievable region for the AWGN Partially Cooperative 
RBC. Furthermore, for the AWGN Fully Cooperative RBC, the maximum rates of both users 1 
and 2 are improved relative to the original Gaussian broadcast channel. However, for the AWGN 
Partially Cooperative RBC, the maximum rate of only user 2 is improved. This is because user 2 
in the AWGN Fully Cooperative RBC helps user 1 through a relay link, which is not allowed for 
the AWGN Partially Cooperative RBC. 




Figure 8: Comparison of rate regions for Gaussian RBCs 



5 Fully Cooperative RBCs with Feedback 



In this section, we study the Fully Cooperative RBC with feedback, where the outputs at user 2 
are provided to user 1 and the outputs at both users 1 and 2 are provided to the source all through 
perfect feedback links (see Figure 121) • We study how feedback affects the Fully Cooperative RBC. 

For a distribution on the message set p{wo, wi,W2), the following joint distribution is induced for 
a Fully Cooperative RBC with feedback 

p{wo, Wi,W2,x'^,Xi, X2, Vi, 2/2 ) 
n 

= p{wo, wi,W2)Y[ Pixi\wo, wi,W2, ?/*r\ y2'^)pixi,i\y'f^, 2/2^^) (43) 

i=l 

■ P{x2,i\y2~^)Piyi,i^ y2,i\Xi, Xl^i, X2,i) 
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Figure 9: Fully Cooperative RBC with feedback 



5.1 Discrete Memoryless Fully Cooperative RBCs with Feedback 

Since the Fully Cooperative RBC with feedback is degraded, we can obtain the capacity region of 
this feedback channel. 

Theorem 16. (Capacity Region for Fully Cooperative RBC with Feedback) The capacity region of 
the Fully Cooperative RBC with feedback is given by the rate region with the rate tuples {Rq, Ri,R2) 
that satisfy 

Ro + R2 < uim{l{U,Xi;Y2\X2),I{U;YuY2\Xi,X2)}, 
Ri<IiX;YuY2\U,Xi,X2) 

for some joint distribution p(xi,X2,u)p{x\u)p(yi,y2\x,xi,X2)- The auxiliary random variable U is 
bounded in cardinality by \U\ < \X\ ■ \Xi \ ■ \X2 \ + 2. 



Proof. Theorem ini provides the achievability with (Yi, Y2) replacing Yi as the output at user 1. The 
proof of the converse is similar to those for Theorems El and IHl and is hence omitted. □ 

Remark 7. From the proof of the achievability, the source does not exploit feedback information 
to achieve the capacity region of the channel. Hence even if the channel only has feedback from the 
user 2 to user 1, the capacity region is still the same as the channel with additional feedback from 
both users to the source. This is similar to what we have remarked for the Partially cooperative 
RBC with feedback. 

Remark 8. For the Fully Cooperative RBC, since the output at user 2 is fed back to user 1, it may 
seem that the relay link from user 2 to user 1 would not serve a useful purpose. This is indeed true 
for Gaussian channels as we will study in the next subsection. However, this may not be the case 
for the discrete memoryless channel. The reason is that although user 2 does not need to forward 
any information to user 1, the relay input sent by user 2 may still affect the channel. Hence user 
2 can send a single codeword through the relay link to result in the best achievable region. 
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Note that if the original Fully Cooperative RBC is degraded, the capacity region given in Theorem 
1161 is the same as the capacity region for the same channel without feedback given in Theorem 1121 

Corollary 5. Feedback does not increase the capacity region of the degraded Fully Cooperative 
RBC. 

5.2 Gaussian Fully Cooperative RBCs with Feedback 

In this section, we study two Gaussian Fully Cooperative RBCs with feedback: the D-AWGN and 
the AWGN cases. 

We first have the following capacity theorem for the D-AWGN Fully Cooperative RBC with 
feedback. 

Theorem 17. (Capacity Region for D-AWGN Fully Cooperative RBC) Feedback does not increase 
the capacity region for the D-AWGN Fully Cooperative RBC, i.e., the capacity region for the D- 
AWCN Fully Cooperative RBC with feedback is the same as the capacity region for the D-AWGN 
Fully /Partially Cooperative RBC, and is given by Theorem^ 

Proof. The proof of the achievability is given by that for the D-AWGN Fully Cooperative RBC 
without feedback. The proof of the converse is similar to that for the D-AWGN Partially Cooper- 
ative RBC with feedback, which is given in Appendix El D 

Note that for the D-AWGN Partially Cooperative RBC, we have studied a Self-Interfered channel, 
which is a reasonable model from a practical point of view. Similarly, it is of interest to study the 
following Self- Interfered D-AWGN Fully Cooperative RBC model, where the outputs at users 1 and 
2 are given by 

Yi=X + aXi + bX2 + Zi 

(45) 

Y2 = X + Xi + dX2 + Zi + Z' ^ ^ 

where Zi and Z' are independent zero mean real Gaussian random variables with variances A^i and 
N2 — Ni, respectively, and parameters a, b and d are real numbers. 

Note that the Self-Interfered D-AWGN Fully Cooperative RBC is also degraded. Theorem El 
still holds for this channel with feedback. 

Corollary 6. The capacity region for the Self- Interfered D-AWGN Fully Cooperative RBC with/without 
feedback is the same as the capacity region for the D-AWGN Fully Cooperative RBC with/without 
feedback, and is given in Theorem \ll\ 

We now consider the AWGN Fully Cooperative RBC with feedback. The following theorem 
provides the capacity region for this channel. 

Theorem 18. (Capacity Region for AWGN Fully Cooperative RBC with Feedback) The capacity 
region for the AWGN Fully Cooperative RBC with feedback is the same as the capacity region for 
the AWGN Partially Cooperative RBC with feedback given in Theorem\^ i.e., the capacity region 
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is given by the rate region with the rate tuples {Rq, Ri, R2) satisfying 

Ro + R2 < max mill [c | ^ "^J" '^^J^^E ^\ q f ^"'^ 

0</3<i \ 1^ aP + N2 J \aP + ^^ 



Ri<C 
for some a G [0, 1] . 



aP 

N1N2 
N1+N2 



(46) 



Proof. The proof follows similarly as that for Theorem |HJ and is briefly summarized as follows. 
We define 

and the mapping from (Yi,!^) to (S", I2) is one-to-one. Hence the channel with the outputs being 
(Yi,y2) and I2 is equivalent to the channel with the outputs being (S", I2) and ¥2- 

We express S and Y2 in the following form 

where Z, := "'g+j^f' and Z := jj^iZ, - Zi)^ 

It is clear that Z is independent of X, Xi and X2, and is also independent of Zi. Hence Z 
is independent of S. Therefore, Y2 is independent of X, given {S, Xi, X2), i.e., I2 is a degraded 
version of S. 

Now, for the equivalent channel with outputs being (5, Y2) and Y2, we have 

S = X + — Xi + — X2 + Zi 

N1+N2 ^ N, + N2 ' (50) 

Y2 = X + Xi + Zi + Z 

where Zi and Z are independent zero mean real Gaussian random variables with variances ^^^^^ 
and Tj^^, respectively. 

This is a Self-Interfered D-AWGN Fully Cooperative RBC defined in H45|) with feedback, and 
hence Corollary El can be applied to yield the capacity region. □ 



We have the following remarks for the capacity region for the AWGN Fully Cooperative RBC 
with feedback. 

Remark 9. Theorem imvlies that feedback effectively changes the AWGN Fully Cooperative 
RBC with feedback to a D-AWCN Fully Cooperative RBC with feedback but with noise variance Ni 
being replaced by -^j^. 

Remark 10. For both D-AWGN and AWGN Fully Cooperative RBCs with feedback, their capacity 
regions are the same as the corresponding Partially Cooperative RBCs with feedback. Hence, for 
these two Gaussian channels with feedback, the relay link from user 2 to user 1 does not help, 
because all the useful information at user 2 has been conveyed to user 1 through feedback. 
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We now compare the capacity region of the AWGN Fully Cooperative RBC with feedback given 
in Theorem 1181 with the outer bound on the capacity region of the AWGN Fully Cooperative RBC 
given in Theorem 1151 It is clear that the capacity region of the AWGN Fully Cooperative RBC 
with feedback contains the outer bound on the capacity region of the AWGN Fully Cooperative 
RBC without feedback. In particular, for small values of the relay power P2, the capacity region of 
the AWGN Fully Cooperative RBC with feedback strictly contains the outer bound on the capacity 
of the same channel without feedback, i.e., feedback enlarges the capacity region for the AWGN 
Fully Cooperative RBC for these cases. 



6 Comments on Power Constraints 

In Section 12.31 we showed that the achievable region of the AWGN Partially Cooperative RBC 
(given in Corollary^ is larger than the capacity region of the original Gaussian broadcast channel. 
This is also demonstrated by numerical example in Figure |SJ However, this comparison is based on 
the assumption that the power constraint at the source for the AWGN Partially Cooperative RBC 
is the same as the power constraint at the source for the Gaussian broadcast channel, and that 
there is an additional power Pi for the relay node (user 1) to transmit relaying information. Hence 
it is conceivable that the improvement in the capacity region for the AWGN Partially Cooperative 
RBC is due to this additional power at the relay node. We now consider a case for the AWGN 
Partially Cooperative RBC where the total power available for the source and relay is the same as 
the power available for the source in the broadcast channel, i.e., the source and the relay node need 
to share the amount of power P. We explore whether the AWGN Partially Cooperative RBC still 
has a larger capacity region than the Gaussian broadcast channel. 



1.5 




R1 (bps/Hz) 

Figure 10: Comparison of rate regions 
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In Figure lTUl we plot the achievable rate region (boundary with solid line) for the AWGN Partially 
Cooperative RBC, where A^i < and where the source and the relay node share the amount of 
power P. We compare this achievable rate region with the capacity region (boundary with dashed 
line) of the Gaussian broadcast channel with the power constraint P for the source. It is clear 
from the graph that the achievable region of the AWGN Partially Cooperative RBC is larger than 
the capacity region of the Gaussian broadcast channel. Clearly this enlargement is not due to the 
additional power at the relay node any more. The gain comes from the fact that the source and 
relay can coherently transmit information to user 2. Of course this gain due to coherent combining 
is limited by how much information the source can forward to the relay node before the two nodes 
can actually cooperate. Hence the stronger the link from the source to relay is, the larger the 
coherent combining gain that can be achieved. Since we have assumed that A'^i < N2, which means 
that the source can forward more information to the relay than to user 2 through the direct link 
from the source to user 2, the coherent combining gain always exists even if it may be small. 
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Figure 11: Comparison of rate regions 



We next consider the AWGN Partially Cooperative RBC where A^i > N2, i.e., where the relay has 
a worse channel from the source than user 2. We note that when the relay has an additional power 
Pi, the achievable region given in (|2U|) is larger than the capacity region of the original Gaussian 
broadcast channel. Now even when the source and relay are subject to a sum power constraint 
P, the achievable rate region based on the estimate-and-forward scheme for the AWGN Partially 
Cooperative RBC is larger than the capacity region of the original broadcast channel (see Figure 
llip . However, this improvement is not due to coherent combining between the source and the relay 
as in the case where Ni < N2. The reason for the improvement is that in this case the source needs 
to split some power for the relay and hence the source signals cause less interference at the relay. 
Thus the relay is able to decode at at a higher rate. Figure ^2 also suggests that this improvement 
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is small, and that the maximum rate of user 2 is not improved. This suggests that in the case 
where the relay has a worse channel from the source than user 2, the relay transmission may not 
help much in enlarging the capacity region unless an additional amount of power is available at 
the relay. On the other hand, in this case letting user 2 be the relay node makes the relaying 
more helpful, because now the relay (user 2) has a better channel from the source than user 1, and 
coherent combining helps to enlarge the capacity region. 

Similarly, the achievable rate region of the AWGN Fully Cooperative RBC, where the source and 
two users share the amount of power P, is larger than the capacity region of the original Gaussian 
broadcast channel with the source subject to power constraint P. In the AWGN Fully Cooperative 
RBC, the relay node with a better channel from the source helps more towards enlarging the 
capacity region due to coherent combining. The relay node with a worse channel from the source 
helps only a little due to less interference in decoding as in the preceding discussion. 

7 Concluding Remarks 

We performed a comprehensive information-theoretic study of two relay broadcast channels, the 
Partially Cooperative RBC and the Fully Cooperative RBC. We derived bounds on the capacity 
region for these channels, and established the capacity region for the special cases of degraded chan- 
nels. We demonstrated via Gaussian examples that these RBCs have significant gains in capacity 
region compared to standard broadcast channels. Our results suggest that cooperative relaying is a 
powerful technique in achieving high speed communication for wireless downlink systems and other 
networks that include broadcast transmissions. 

In analyzing the capacity regions of RBCs, We provided an alternative to the cut-set bound 
approach to obtain outer bounds. We showed that our outer bounds are tighter than those based on 
the cut-set bound, and that they are close to the corresponding inner bounds in Gaussian examples. 
We believe that our technique for deriving these outer bounds is applicable more generally, and 
may be useful in deriving tighter outer bounds than the cut-set bound in other network information 
theory problems. 

For the RBCs studied in the paper, the relay is allowed to transmit and receive at the same 
time in the same frequency band. In practice, models where the relays transmit and receive in 
orthogonal channels may be of interest. These RBCs have been studied in recent papers from an 
information-theoretic viewpoint [HI El) and in the fading channel context |31j . 

In this paper, we have focused purely on the information-theoretic aspect of the RBCs. Further 
studies on this topic from coding and networking viewpoints will allow for the implementation of 
relaying and user cooperation in future wireless networks. 

Appendix 

A Outline of Proof for Theorem [T] 

We assume that the source uses the superposition coding which is optimal for the degraded broad- 
cast channel jHl Chapter 14.6]. We also assume that the relay (user 1) uses the decode-and- forward 
relaying scheme [HI Section II]. We adopt the regular encoding/sliding window decoding strategy 
for the decode-and-forward scheme which is different from the irregular encoding/successive 
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decoding strategy used in [3 Section II]. A review of three decode-and-forward strategies can be 
found in ^ . 

We first prove that without common message Wq, the fohowing rate pair is achievable: 



Then, from the following proof, it is easily seen that user 1 decodes the messages for both users 1 
and 2. We can hence view part of the rate R2 to be the common rate Rq, and the rate region given 
in Theorem n is achievable. 

We consider a transmission over B blocks, each with length n. At each of the first B — 1 blocks, 
a message pair {Wi,i,W2,i) G [l,2"-^i] X [l,2"'f^2] ig encoded and sent from the source, where i 
denotes the index of the block, and i = 1,2, . . . , B — 1. For fixed n, the rate pair (^Ri^^ , R2^^) 
approaches (i2i,i?2) as S — 00. 

We use random codes for the proof. Fix a joint probability distribution of Xi, U, X,Yi,Y2: 



where U is an auxiliary random variable that stands for the information being carried by the source 
input that is intended for user 2. In the following, we use A^"'^ to denote the jointly e-typical set 
(see [HI Chapter 14.2] for definition) based on this joint distribution. 

Random Codebook Generation: We generate two statistically independent random codebooks 1 
and 2 by the following same steps. 

1. Generate 2"^^ each with distribution 11^=1 Index ^^(wg), W2 € [1,2"^2], 

2. For each Xi{w'2), generate 2"^^ i.i.d. u each with distribution YVi=iP{'^i\^i,i{''^2))- Index 
u{w'2,W2),W2e[l,2''^^]. 

3. For each Xi{w2) and u{w2,W2), generate 2"'^^ i.i.d. x each with distribution 

nr=iP(^il'"*(^''^2),a;i,i(u;2)). Index x(w2 , -^2 , tt^i ) , wi € [1,2"-^^!]. 

Encoding: We encode messages using codebooks 1 and 2, respectively, for blocks with odd and 
even indices. This is because some of the following decoding steps are performed jointly over two 
adjacent blocks, and having independent codebooks makes the error events corresponding to these 
blocks independent, thus making the probabilities of these error events easy to calculate. 

At the beginning of block i, let W2,j) be the new message pair to be sent from the source in 
block i, and {wi^i-i, 102,1-1) be the message pair being sent from the source in previous block i — 
The source encoder then sends x{w2,i-i, W2,i, wi^i) . 

At the beginning of block i, user 1 (relay node) has decoded the message W2,i-i transmitted from 
the source in previous block i — It then sends the codeword Xi{'W2,i~i)- 

For convenience, we list the codewords that are sent in the first three blocks in the following 
table. 



R2<inm{l{U,Xi;Y2),I{U;Yi \ Xi)} 
Ri<I{X;Yi I U,Xi). 



(51) 



p{xi)p{u\xi)p{x\u, xi)p{yi,y2\x, xi) 



block 1 



block 2 



block 3 




Xl{w2,l) 

U {W2,1,W2,2) 

X iw2,l,W2,2,Wi,2) 



^1(^2,2) 

U {W2,2,W2,3) 

X iw2,2,W2,3,'Wi,3) 
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Decoding: The decoding procedures at the end of block i are as follows. 

1. User 1, having known W2,i-i, declares the message W2^i is sent if there is a unique 'W2,i such 
that (^Xi{w2,i-i),u{w2,i-i,W2,i),y-^^{i)^ € A^^'K It can be shown that the decoding error in this step 
is small for sufficiently large n if 

R2 < I{U;Yi\Xi). (52) 

2. User 1, having known W2,i-i and 1^2,1, declares the message wi^i is sent if there is a unique 

wi^i such that ^X;^(i(;2,i-i), M(u'2,i-i, tf^2,i)5^('"^2,i-i, ^^2,15 ^^'i.j)' y^lO) ^ Ai"'\ It can be shown that 
the decoding error in this step is small for sufficiently large n if 

Ri < I{X;Yi\U,Xi). (53) 



3. User 2, having known 11)2,1-2, decodes W2,i-i based on the information received in blocks 
i — 1 and i. It declares that the message W2,i-i is sent if there is a unique W2,i-i such that 

{xi{w2,i~2),u{w2,i-2,W2,i-i),y^{i - 1)) G ^e"^ and {xi{w2A-i),y2{i)) G ^e"^- It can be shown that 
the decoding error in this step is small for sufficiently large n if 

R2 < I{U;Y2\Xi) + I{Xr,Y2) = I{XuU;Y2). (54) 

Combining equations (j52|l . (j53|l and ([Hill , we conclude that the rate region given in ([5T1) is 
achievable. 

Finally, the cardinality of the auxiliary random variable U can be bounded by applying standard 
techniques (e.g., see j7| Lemma 3.4]). 



B Proof of Theorem [2] 

The proof uses techniques that are used in proving the converse of the capacity region of the 
degraded broadcast channel jHl Chapter 14, Problem 11], and in proving the upper bound on the 
capacity region for the relay channel Section III]. 

We consider a sequence of (2"^o,2"^i,2"^2,n) codes for a Partially Cooperative RBC with 

(n) 

Pe 0. Then the probability distribution on the joint ensemble space Wq x Wi x W2 x Af" x 
X X is given by 

p{wo, wi,W2,x'^, x", y", ^2 ) 

n 

= p{wo)p{wi)p{w2)p{x"\wo, wi, W2) JJp(xi,i|yi""^)p(yi,i, y2,i\xi, xi,i). 



(55) 



4 = 1 



By Fano's Inequality, we have 

^(W^iln") < H{Wo, P^ilFi") < n{Ro + i?i)pW + 1 := ndi,n 
H{W2\Yi') < H{Wo, VF2|y2") < n{Ro + i?2)Pi") + 1 := n^a.n 

Note that 5i,„, 52,n ^ if p]"^ ^ 0. 



(56) 
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We first consider 



(57) 



nRo + nR2 = HiWo, W2) = I{Wo, W2; Y^) + H{Wo, M^sIlT) 

<I{Wo,W2\Y^)+n52,n 
n 

= J2 liWo, W2;Y2,i\Yt^) + n52,n 

i=l 
n 

= J2 H{Y2,i\Yt') - H{Y2,i\Yt\Wo, W2) + nS2,n 

i=l 
n 

< J2 H{Y2,i) - H{Y2,i\Yt\ VFo, W2, Yt\Xi,i) + nS2,n 

i=l 
n 

= J2H{Y2,i) - H{Y2,i\Ui,Xi,i) + nS2,n 

i=l 
n 

= ^7(C/i,Xi,i;y2,i)+"'^2,n 

i=l 

where we defined Ui := {Wo,W2,YI-^,Y^-^). Note that Xi^i Ui ^ Xi form a Markov chain, 
and Ui — {Xi,Xi^i) {Yi^i,Y2^i) also form a Markov chain. 

We then consider 

nRo + nR2 < I{Wo, W2; 1^) + «'^2,n < I{Wo, W2;Y^, ^i") + nS2,n 

T). 



Y,IiWo,W2;Y2,i,Yi,i\Yi-\Yl-') + n62,n 

i=l 

n 

H{Wo, W2\Yt\Yi-^) - H{Wo, W2\Yl Y^) + nS2,n 

i=l 

(a) " 

< ^ H{Wo, W2\Y^-\Yl-\Xi,i) - H{Wo, W2\Y^, Y^ Xi,^) + n52,n 

i=l 

n 

W2; Y^^i, Y2,i\Yl-\Yt\Xr^i) + n52,n 

i=l 

n 

= YHiYi,i,Y24Yt\Yi-\Xi,i)-H{Yi,i,Y24Yt\Yi-\Xi,i,Wo,W2) + nd2,n 

i=l 

n 

< YHiYi,i,Y2,i\Xi,i) - H{Yi,i,Y2,i\Ui,Xi,i)+nd2,n 

i=l 
n 

= 5^/(C/i;yi,i,y2,i|^M) + n52,n 

i=l 

(58) 

where (a) follows from the fact that conditioned on {Y2~^ ,Y^~^), Xi^i is independent of Wq, VF2. 
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We next consider 

nRi = H{Wi) = /(TVi; Fi") + H{Wi\Y{') < /(TVi; Y^', Yl\ T^o, W2) + n^i,, 

n 

= /(W^i; n,., Y2,^\Yl-\Yt\Wo, W2) + n5i,n 

i=l 
(6) " 

1=1 

n 

< J2 H{Yi,^, Y24Ui,X,,,) - H{Yi,i, Y2,i\Yl-\Yt\Wo, W2, VFi, Xi,^, X^) + (59) 

i=l 
n 

= Y H{Yi^u Y2AUuXi,i) - H{Yi^i, Y2,i\Yl-\Yt\Wo, W2, X,) + n5i,„ 

i=l 
n 

= J2 H{Yi,u Y2,i\Ui,Xi^i) - H{Yi,i, Y2,i\Uu Xi^i,Xi) + n5i,„ 

i=l 
n 

= Y liXf, Y,,i, Y2,i\Ui,X,,i) + n6i,n 

i=l 

where (6) follows from the same reasoning as in the steps from (p) to (q) in (|58|) . 
We now consider 

nRo + nRi = H{Wo, Wi) = I{Wo, Wi; Y^") + H{Wo, VFiln") 
<I{Wo,Wi;Y,^) + n6i,n 



Y,IiWo,Wi;Yi,i\Yt') + n6i,n 



i=l 



(c) 

< YHWo,Wv,Yi4Yl-\Xi,i)+n6i,n 

i=l 

n 

< Y H{Yi^^\Yi~\Xi^i) - H{Yi^i\Wo, Wi,Yl-\Yt\Xi,i) + nSi,n 

i=l 

n 

<Y,H{Yl^^\Xl^,) - H{Yi^i\Ul,Xi,i,)+n6i,n 

i=l 

n 



i=l 



(60) 



where (c) follows from the same reasoning as in the steps from [p) to {q) in 1)58(1 . We defined U[ :- 
{Wo,Wi,yI-\Y^-^). Note that X^^i ^ Xi form a Markov chain, and C// ^ - 

(Yi^i,Y2^i) also form a Markov chain. 
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We finally consider 

nR2 = H{W2) = IiW2; Y^) + H{W2\Yi') 

< /(VF2; ¥2^) + n62,n < I{W2; , Y^, Wq, Wi) + nJa.n 
= I{W2; ir, Yi'lWo, Wi) + n62,n 

n 

= J2 HW2; Y2,^\Y^-\Y^-\ Wo, Wi) + n62,n 

1=1 
(d) " 

< S2I{W2■,Yl,^,Y2,^\Y^-\Y^-\Wo,Wl,Xl,i)+n62,n 

7^1 (61) 

n 

< J2 H{Yl,^, Y2,^\Ui Xi,,) - H{Yi^,, Y2,^\Y^-\Y^-\ Wo,Wi, X^) + n62,n 
1=1 

n 

= Y,H{Yl^^,Y2,^\UiXl,i) - H{Yl,^,Y2,^\UiXl,i^X,) +n52,n 
1=1 
n 

= J2HXi■,Yl,^,Y2,^\Ui,Xl^i)+n52,n 

1=1 

where (d) follows from the same reasoning as in the steps from (p) to (q) in 1)58^ . 

Now in order to change the upper bounds that we have derived in (jSTJ-lj^J) to single letter charac- 
terizations, we introduce a random variable Q which is independent of Wq, Wi, W2, X'^ , , Y{^, Y^^, 
and is uniformly distributed over {1,2, ... ,n}. Define U = {Q,Uq), U' = {Q,Uq), X = Xq, 
Xi = Xi^Q, Yi = Yi^Q, and Y2 = ^2,Q- Clearly, we have Markov chains: Xi ^ U ^ X , 
Xi — > [/' ^ X, and {U,U') —> {X,Xi) {Yi,Y2). By using the above definitions, equations 
(jnZIl-jnil, become 



i?0 + i?2 < ^ I{Ui, Xi^i- Y2,i) + b2.n = I{Uq,Xi^q-Y2,q\Q) + S2,n 

1=1 

< I{Q, Uq,Xi^q;Y2,q) + S2,n = I{U, Xi;Y2) + S2,n 

1 " 

R0 + R2<-J2 ^(^^5 ^1.*' ^2,*1^1,*) + = I{Uq; Yi,Q, Y2,q\Xi,Q, Q) + 82,n 

t=l 

< I{Q,UQ;Yi,Q,Y2,Q\Xi,Q)+62,n = I{U;Yi,Y2\Xi) + 62,n 

1 " 

i?i < - I{Xi;Yi,„Y2,,\Ui,Xi,^) + Si,n = I{Xq;Yi^q, Y2,q\Uq, Xi^q, Q) + 5i^n 

i=l 

= I{X-Yi,Y2\U,Xi)+5i^n 

i=l 

< I{Q, U'q- yi,Q|Xi,Q) + = /([/'; nlXi) + 

n 

R2<-Y1 ^(^*; Yh^y^MUi Xi,,) + S2,n = I{Xq; Yi,q,Y2,q\U^, Xi,q, Q) + S2,n 
1=1 

= I{X;Yi,Y2\U',Xi)+52,n 



(62) 



(63) 



(64) 



(65) 



(66) 
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C Proof of the Converse for Theorem [H] 



We only need to add the following steps for equations H58|) and (|59|) in Appendix^ by taking into 
account of the degradedness condition defined in Definition |31 For equation H58() . we have 



nRo + nR2 < ^ /(^7i; l2,*|^i,i) + ^'^2,™ 
1=1 

n 

= I{Ui;Yi^,\Xi,i) + /([/,; F2,^|^l,^, + nS2,n (67) 

i=l 

n 

= Yl{Ui;Yi^i\Xi^i) +n62,n 
1=1 

where /(C/j; y2,i|^i,«i = follows from the degradedness condition given in Definition EJ 
For equation we have 



nRi < J^/(Xi;yi,i,y2,i|^i,Xi,,)+n5i,„ 

i=l 
n 

I{Xi;Yi,,\Ui,Xi^,) + I{Xf, Y2,i\U,, Xi^i, Yi^i) + n5i,„ (68) 

i=l 
n 



1=1 



where I{Xi]Y2 i\Ui,Xi j, li j) = also follows from the degradedness condition given in Definition 

H 

Therefore, ()57() in Appendix^ 1)67(1 and ()68p constitute the converse for the degraded Partially 
Cooperative RBC. 



D Proof of the Converse for Theorem [B] 

The proof is similar to that for Theorem |21 given in Appendix^ We hence provide only an outline, 
which will be useful in the following proof for the Gaussian case in Appendix IeI 

We consider a sequence of (2"^°, 2"^^, 2"^^ ^ j^) code with pj"^ 0. Then the probability distri- 
bution on the joint ensemble space Wq x VFi x W2 x Af" x x J^" x is given by 

p{wQ,wi,W2,x'\xi,yi,y2) 

n (69) 
i=l 

By Fano's Inequality, we have 

H{Wi\Y^,Y^) < HiWo, ^2") < ^(^0 + i?i)^i") + 1 := n<5i,„ 

H{Wo, W2\Y2n < n{Ro + R2)P^''^ + 1 := n62,n 
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where (5i^„, 52,n if Pi"^ ^ 0. 

The proof for the following two bounds follows steps that are identical to those in equations 1)57(1 
and in Appendix IbI 



nRo + nR2<Y, I{U^, Xl^i■,Y2,^) + n52,n. (71) 
1=1 

n 

nRo + nR2 < /(t/»; ll.i, l2i|^M) + ^'^2,n (72) 



1=1 



(73) 



We now consider 

nRi = H{Wi) = I{Wi;Y,^, Y^^) + H{Wi\Y,^, Y^) 

< /(^i; yi", 1^, Wo, W2) + nSi^n 

n 

< ^/(X,;yl,i,y2,^|f^^,^M)+n^l,n 
i=l 

where we omitted the steps that are identical to those in equation ((5^ in Appendix IbI 



E Proof of the Converse for Theorem [7| 

The techniques in the proof of the converse for the capacity of the physically degraded Gaussian 
relay channel Section IV] are useful here, but are not sufficient. In particular, the parameters 
a and (3 need to be carefully chosen. Moreover, this proof applies the entropy power inequality 
to the components of the two random vectors, which is different from applying the entropy power 
inequality to two independent random vectors as in the proof of the converse for the capacity 
region of the degraded Gaussian broadcast channel. A similar idea has been used in establishing 
the capacity region of the physically degraded Gaussian broadcast channel with feedback Jllj. 

For the D-AWGN Partially Cooperative RBC, the power constraints at the source and relay 
imply that the codewords satisfy 

n n 

5^ EXf < nP, Yl ^ • (74) 

1=1 i=l 

We apply the degradedness condition to the bounds ((7T|) . (|72() and ((751) in Appendix^and obtain 
the following bounds: 



Ro + nR2<Yl IiU^,Xi,,- Y2,i) + n52,n, (75) 
1=1 

n 

R0 + nR2 < Y,^(U^■^"^h^\Xh^)+nS2,n, (76) 
1=1 

n 

Ri < Y,HXi-^Yi,^Pi,Xi,i)+n6i,n. (77) 



n 

1=1 
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We now apply the bounds for the D-AWGN Partially Cooperative RBC. We start with 

((7^ . and obtain 

n 

nRo + ni?2 < ^ h{Yi^i\Xi^i) - h{Yi^i\Xi^i, Ui) + n^s.n- (78) 

i=l 

For the second term in the sum in H78|) . we have 

n n n " i 

1=1 i=l i=l i=l 

< ^ log 27re EXf + iV,^ < ^ bg 27re(P + iVi) 

On the other hand, 

n n n 

J2HYl,^\Xl,^,Ui) >YHYi,i\Xi,uUi,Xi) = Y,HyiMXi) = ^log27reiVi (80) 

i=l i=l i=l 

where we used that given Xi, Yi j is independent of Xi j, C/j. 
Combining H79|) and H8U() . we establish that there exists some a £ [0, 1] such that 



For the first term in the sum in ((THJ 

n n " 1 

^/i(yi,i|Xi,,) = Y E/i(n,i|^i,i) < E-log27reVar(yi,,|Xi 

1=1 i=l i=l 

1 " 

< - ^log27reE Var(Xi + 

i=l 

1 

= - ^log27re(EVar(Xi|Xi,,) + iVi) 

i=l 

< ^log2^e ^i^EVar(X,[Xi,,)+iVi^ 

= il°g2.e ij:[E(xf)-E(E^(X.|Xi,)) 



n 

i=l 



< ^ log 2^e - i ^ E (E2(X,|Xi,,)) + iVi j 



h[Yi^^\Xi,„Ui) = " 

i=l i=l 

where we have used equation (|HT|) . 
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(79) 



^/i(yi,i|Xi,„[/,) = ^log2^e(aP + iVi) (81) 

i=l 



(82) 



On the other hand, we know that 

n n 

YHYiMXia) > ^/i(>l,*l^i,i,f^i) = ^log27re(aP + iVi) (83) 



Combining (|H^ and 1)83(1 . we obtain 

1 " 

aP + N,<P--J2^ (E2(Xi|Xi,,)) + iVi 

1 " 

i=l 

where a = 1 — a. Hence, there exists some /? G [0, 1] such that 

1 " 

-^E(e2(X,|Xi,,)) =/3aP 



n 

i=l 



where /3 = 1 — /3. 
We plug the preceding equation in , and obtain 

n 

h{Yi^,\Xi^i) < ^ log 27re (P - PaP + A^i) = ^ log 27re (aP + (3aP + TVi^ 
We plug (jHU and dHSJ in and obtain 

7Z 71/ 

nRo + nR2 < - log 2-Ke {aP + PaP + Ni) - - log 27re (aP + Ni) + n52,n 
n, / paP \ 

We next consider the bound ((7^ . and have 

n 

nRo + nR2 <Yh{Y2,i) - h(Y2,i\Ui, Xi,^) + n52,n- 
1=1 

The first term in the sum in (|88() can be bounded 

n n 

J] h{Y2,^) = h{Xi + Xi^i + Zi,, + 

i=l 
n . 

< 5^ - log 27re (E(X, + Xi,,)^ + iVs) 

i=l 

< ^ log 27re E(Xi + Xi,,)' + iV2^ 



i=l i=l 
n 
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For the sum in the preceding equation, we have 

n n ^-^ n ^-^ ' n ^-^ 

i=l i=l i=l i=l 

n 

<P + Pi + -Ve (Xi,,E(Xi|Xi,i)) 
n ^-^ 

^ ^ + ^1 + ^ E V^^M • E (E^(^il^i,0) 

i=l 



< P + Pi + 2 

< P + Pi + 2VPi/3aP 

Hence we obtain 



^EE^?.V(^EE(E^(^d^M)) 



n — ' ' / \n 

. i=l / \ i=l 



^(^2,^) < ^ log 27re [P + Pi + 2^Pi^aP + iVs) 
i=i ^ 

The second term in the sum in (|88j) can be expressed as 

n n 

i=l 
n 

J2h{Yi,i + Zi\Ui,Xi,,) 

i=l 
n 

Y E/i(li,j + Z'i\Ui = Ui,Xi^i = xi,, 



i=l i=l 
n 



i=l 

We now use the entropy power inequahty, and obtain 

22h{Yi^i+Z'-\Ui=Ui,Xi^i=xi^i) 2^H^'i-,iWi=Ui,Xi^i=xi^i) _|_ 2'ih{^i\Ui=Ui,Xi^i=xi^i) 

^ 22h(Yi,,\Ui=u„X^^i=xi,,) _^ 2TTe{N2 - Ni) 

Then, 

h{Yi^^ + Zi\Ui = Ui,X,,, = xi.i) > ^ log (2^HY.MU.=u.,x,,,=x,,) ^ 2vre(7V2 - Ni] 
Hence, 

E/i(yi,, + = u„Xi,, = xi,i) > ^Elog (2^KYiMU.=u.,x^,.=x,,) ^ 2vre(iV2 - iVi) 

> ^ log (^22E'*(^i^'l^«="-^i.^=^'i.>) + 27re(7V2 - iVi) 

> ^ log (2^h(ylMU^,Xl,.) + 27re(7V2 - Ni] 
where we used the fact that log (2^ + c) is a convex function. 
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We plug the preceding equation in and obtain 



i=l i=l 



> - log f22^Sr=iMn.|C/.,Xi,) +27re(7V2 -iVi) 



-log^z n^^=, V " z7rei^iV2 - ivi;^ (^g3^l 

^ log (27re(aP + iVi) + 27re(iV2 - iVi)) 

71 

= -log(27re(aP + 7V2)) 

where (a) also follows from the fact that log(2^' + c) is a convex function, and (6) follows from (|8ip . 
We plug (jnH and (ESI) in (IHHl), and obtain 



nPo + nR2 < - log „ , h n(!)2,n 

2 aP + A'2 



n aP + Pi + 2V/3aPPi \ , ^ 

— log 1 H + nO' 

2^1 aP + iV2 



(94) 



2,n 



We now consider (|77|) . and have 

n 

nPi < ^/i(yl,^|C/^,Xl,,) - /i(yi,,I[/„Xi,„X,) +n,5i,„ 

i=l 
n 



ft Tl 

- log2^e(aP + iVi) - - log(2^eiVi) + n5i,„ 



(95) 



Therefore, 1)8 7p . ()94p and H95|) provide the converse for Theorem [7| 



F Outline of Proof for Theorem [S] 

The proof uses the techniques in proving Theorem |H1 and techniques in Appendix lEl 

In the proof for Theorem|Hl we have shown that the mapping from (Yi, I2) to {S, Y2) is one-to-one, 
where 

S = X + —^—Xi + Zi 

N1+N2 ' (96) 



Y2 = X + Xi + Zi + Z 



where Zi and Z are independent zero mean real Gaussian random variables with variances ^^^^^ 



and jy^^^jy^ , respectively. We have also shown that given {S,Xi), Y2 is independent of X. 
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From equations H57() — (I^U)) in Appendix^ we have the following upper bounds: 

n 

ni?o + nR2 = Y^ I{U^,Xi^i; Y2,^) + n62,n (97) 

i=l 



Ro + nR2 < Y.I{Ui;Yi,,,Y2,i\X,^,) +n52,n = ^I{Ui; S„Y24Xi^i) + n62,n 

i=l 1=1 

n 

^IiU,;Si\Xi^,) + 



(J 
i=l 



(98) 



n 

nRi < Y,IiXi■,Yl^^,Y2,^\Ui,Xl,,) + n6i,n = J] /(X,; 5„ Fa.ilt/,, Xi,^) + n5i,„ 

f 

^=^^/(X,;5ilf/„Xi,,)+n5i, 



i=l i=l 

n 



(99) 



i=l 



nRo + nRi < /([//; yi,,|Xi,,) + n^i,, (100) 

i=l 

where (a) and (c) follow from the fact that the mapping from (yi,j,1^2,j) to (5*4, 1^2,?.) is one-to-one, 
and (6) and (d) follow from the fact that given Si and Xi^i, l2,j is independent of Ui and Xj. 

We further bound the equations H97() . (|U5|) and by following similar steps in bounding (f7^ . 
((7^ and ((771) in Appendix ^ with Yi being replaced by S, and Xi being replaced by -j^q^. We 
then obtain the following bounds: 



ni?o + ni?2 < -log I 1 + ^ ^ -\+n52,n, (101) 



n I BaP \ 

nRo + ni?2 < - log 1 + ^ ^^^^ + n62,n, (102) 

n / aP \ 
nPi < -log] 1 + ^^-^ I +n6i,n, (103) 

V Ni+N2 I 



where parameters a and /3 are defined by 

E ^(^^I^M, f/.) = \ log 2.e (aP + ^^^) 
1 " 

- J^E(E2(X,|Xi,i)) =^aP 



(104) 
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We now further bound (|1U0|) 

n 

i=l 
n 

= J2KYiMXi,i) - h{Yi^i\Ui,Xi^i) + n6i,n 

i=l 

n 

< ^ Eh{Xi + - h{Yi,,\UiXi^i,Xi) + n6i,n 
1=1 

< J^E-log27reVar(Xi + Zi,,|Xi,i) - ^ log 27reiVi + n5i,„ 

i=l 

< ^ ^ log 2^e(EVar(X, + iVi) - ^ log 2^eiVi + n5i,„ 

i=l 

< ^ log 27re EVar(Xi +N^-'^ log 27reA^i + n5i,„ 

= ^ log 27re (^^ E ^ {^^) - E (E'(^i |^i,i)) + " ^ log 27reiVi + 

77/ — 71/ 

= - log 27re (P - /3aP + iVi) - - log 27reAfi + n<5i,„ 
Therefore, the bounds given in ()1U1() - H1U3|) and ()1U5() provide the outer bound given in Theorem[21 



G Outline of Proof for Theorem 1101 

We assume that the source uses the superposition coding ^ Chapter 14.6]. We also assume that 
user 1 employs the decode-and- forward relaying scheme Section II], and user 2 employs the 
estimate-and-forward relaying scheme Ul Theorem 6]. As in Appendix we adopt the regular 
encoding/sliding window decoding strategy 1^ for the decode-and-forward scheme. We also use the 
regular encoding/sliding window decoding strategy for the estimate-and-forward scheme, which is 
different from the irregular encoding/successive decoding strategy originally used in Theorem 
6]. 

We first prove that the rate region TZi is achievable for the case where Rq = (without common 
message Wq). It is then easily seen from the following proof that user 1 decodes the messages 
for both users 1 and 2. Hence we can always view part of the rate R2 to be the common rate 
i?o. Therefore we will have proven that the rate region TZi given in Theorem IIUI is achievable. The 
achievability of 7^2 can be shown by following steps similar to those used in proving the achievability 
of TZi with the roles of user 1 and user 2 being switched. 

We consider a transmission over B blocks, each with length n. At each of the first B — 2 blocks, 
a message pair (W^i,i,W2,i) G [l,2""^i] x [1,2"^'2] is encoded and sent from the source, where i 
denotes the index of the block, and i = 1,2, . . . , B — 2. For fixed n, the rate pair {^Ri^^ , R2^^) 
approaches (i2i,i?2) as S — > cx). 
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We use a random coding argument. Fix a probability distribution 

p{xi)p{u\xi)p{x\u, Xl)p{x2)p{yi,y2\x, Xl,X2)p{y2\y2, U, Xl,X2), (106) 

and we use A^J^^ to denote the jointly e-typical set based on this joint distribution. 

Random Codebook Generation: We generate three statistically independent random codebooks 
by following the same steps. 

1. Generate 2"^^ jj ,-!, each with distribution IliLi Index ^^(wg), W2 € [1,2"^2], 

2. For each Xi{w'2), generate 2"^^ i.i.d. u each with distribution YYi=iPi'^i\xi,i{w2))- Index 

3. For each Xi{w'2) and u{w2,W2), generate 2"'^^ i.i.d. x each with distribution 
Ili=iP(xi\ui{w2,W2),xi^i{w2)). Indeii x{w2,W2,wi), wi G [1,2"-^!]. 

4. Generate 2"'^i i.i.d. X2 ^ach with distribution 11^=1 ^'(^2,i)- Index X2(2;')i ^' ^ [l,2"^i]. 

5. For each x 1(102), u{w2,W2),X2{z'), generate 2"^^ i.i.d. y^ each with distribution 

]Ji=iP{y2,i\xi^i{w'2),Ui{w2,W2),X2^i{z')), where the distribution p{y2\u, xi, X2) is induced by the 
joint distribution given by Index y^{w2,W2,z',z), z € [1,2"'^^]. 

Encoding: We encode messages using codebooks 1, 2 and 3, respectively, for adjacent three blocks. 
This is because some of the following decoding steps are performed jointly over two or three adjacent 
blocks, and having independent codebooks makes the error events corresponding to these blocks 
independent, thus making the probabilities of these error events easy to calculate. 

At the source, let {wi^i,W2,i) be the new message pair to be sent in current block i, and let 
{'Wi^i-i,W2,i-i) be the message pair being sent in previous block i — 1. The source then sends 

x{w2,i-l,W2,i,Wi^i). 

At the beginning of block i, user 1 should have an estimation t&2,i-i of the message W2,i-i sent 
in the previous block i — 1. It then sends Xi(u)2,j-i)- 



At the beginning of block i, user 2 should have an estimation ij_2 of the index Zi-2 of the 
compressed signal y^. It then sends X2 (2:1-2)- 



For convenience. 


we list the co 


dewords sent 


in the first four blocks in 


the followin; 


5 table. 


block 1 


block 2 




block 3 


block 4 




^i(l) 


Xl{w2,l] 


I 


^1(^^2,2) 


^1(^^2,3) 




U (l,^f2,l) 


u iw2,i, 


■^2,2) 


U {W2,2,W2,3) 


U {W2,3, 


W2,4) 


X {l,W2,l,Wl^l) 


X {W2,l, 


■U'2,2,''^l,2) 


X {W2,2,W2,3,'WI,3) 


X {W2,3, 


1^2,4,1^1,4) 


a( 1) 


a( 


1) 


X2{ Zi) 


X2{ 


Z2) 


^2 {'^,W2,l,l,Zl) 


^2 ('^2,1 


,W2,2, 1,22) 


y_2 {W2,2,W2,3,ZI,Z3) 


^2 (^2,3: 


,W2,4,Z2,Z4) 



Decoding: The decoding procedures at the end of block i are as follows. 

1. User 1, having known ^2,4-1, declares message W2,i is sent if there is a unique W2,i such that 
^X]^(w2,j-i), M(ii'2,i-i; it'2,i)5 yj^(^)^ G A^J^\ The decoding error in this step is small for sufficiently 
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large n if 

R2<I{U;Yi\Xi). (107) 

2. User 1, having known W2,i-3, ■ ■ ■ ,W2,i and 2:j_4, determines that indexed by Zi-2 is picked 
to compress y^{i — 1) by user 2 based on the information received in blocks i — 2 and i. User 1 
declares the index to be Zi-2 if there is a unique Zj_2 such that 

(^Xi{w2,i-3),u{w2,i-3,W2,i-2),X2{zi-4),y^{w2,i-3,m,i~2,Zi^ - 2)^ £ 

and (^Xi{w2,i~i),u{w2,i-i,W2,i),X2{zi-2),y^ii)^ G ^^"^ 
The decoding error in this step is small for sufficiently large n if 

Ri < IiY2;Yi\U,Xi,X2) + I{X2;Yi\Xi,U). (108) 

3. User 1, having known W2,i-3,W2,i-2 and Zi_4,2;j_2, determines that the message wi,i-2 is sent 
based on the information received in block i — 2. It declares the index to be wi^i-2 if there is a 
unique wi,j-2 such that 

(^Xi{w2,i~3),u{w2,i-3,W2,i-2),x{w2,i-3,W2,i-2,Wl,i^^^ (109) 
y2{w2A-3,W2,^-2,Zi-4,Zi^2),y^{i-'2)) G • (110) 

The decoding error in this step is small for sufficiently large n if 

Ri<IiX;Y2,Yi\U,Xi,X2). (Ill) 

4. User 2, having known W2,i-2, Zi-3 and Zi^2^ determines that the message W2^i-i is sent based 
on the information received in blocks i — 1 and i. It declares the index to be W2,i-i if there is a 
unique t&2,j-i such that 

(^l(w^2,i-2),w(?i'2,i-2,^«2,i-l),X2(zi_3),y2(^ ~ ^)) ^ ^e"^ 

and (^Xi{w2,i-i),X2{zi-2),}l2^i)^ G ^^"^ 
The decoding error in this step is small for sufficiently large n if 

R2 < I{U-Y2\Xi,X2) + I{Xi-Y2\X2) = I{Xi,U-Y2\X2). (112) 

5. User 2, having known 11)2,1-2, W2^i-i and Zj-s, declares that the estimate signal y^ for y^{i — 1) 
is indexed by if there is a unique such that 

(^Xi{w2,i^2),uiw2,i-2, W2,i-l), X2izi^3),y 2^^2,1-2, W^^^ - 1)^ G ^^"^ 

There exists such a with high probability for sufficiently large n if 

Ri> IiY2;Y2\U,Xi,X2). (113) 

Combining 1)108(1 and (|113() . we obtain 

I{X2;Yi\Xi,U) > I{Y2;Y2\U,Xi,X2) - I{Y2;Yi\U,Xi,X2) 
= I{Y2;Y2\Yi,U,Xi,X2), 
which is exactly the constraint given in TZi. 
Combining ifTUT)) . ((TTT|) . (fTT^ . and ((TTH) . we obtain the rate region T^i. 
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H Outline of Proof for Theorem 1141 



Let I2 = Y2 + Z where the variance of Z is denoted by N that will be determined later in the proof. 

We compute the achievable rate region TZi given in Theorem IIUI based on the following distribu- 
tions and relationships for those random variables in the expression of TZi 

Xi ~AA(0,Pi), 

X'^N{^,aP), X = U + X', 

X2 ~AA(0,r/P2), 

where the random variables Xi, U',X',X2 are independent. 

It is straightforward to compute the following two mutual information terms that provide the 
expression for Rq + i?2 



I{U,X^;Y2\X2)=C 
I{U;Yi\Xi)=C 



a 



P + Pi + 2yJ(3aPPi 



aP + N2 
PaP 



(116) 



^aP + +T]P2 + Ni 
To derive Ri, we first have 

R, < IiX;Y2,n\X„U,X2) = C + ^) . (117) 

To determine in the preceding equation, we use the following constraint which is given in the 
expression of TZi 



i{X2 ; n 1 [/, Xi ) > /(y2 ; 1^2 111 , u, Xi,X2) 

= I{Y2-Y2\U,Xi,X2)- !{% ; yi 1 [/, Xi , X2) 
We evaluate the mutual information terms in H118|) . and have 
/(X2;yilC/,Xi) = ^logfl+ "^^^ 



(118) 



2 V aP + NiJ ' 
/(y2;y2|^,Xi,X2) = ^log(l + ^^^±^), (119) 

,1 / aP + N2 + N \ 
I{Y2;Yi\U,Xi,X2) = -log' 



2 \aP + N2 + N-^J' 

We plug the three mutual information terms given in (|119() into (|118() . and derive the following 
constraint on N 

aPiNi + iV2) + N1N2 , , 

N> ^ ' (120) 

r]P2 

We now plug the preceding bound on N in the expression (|117|) . and obtain 

o /cT— + ^ fl2n 

^ V^^i%^2X2 + aP(Xi + X2)+iViiV2y' ^ ' 
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I Outline of Proof for Theorem 1151 



In the proof for Theorem ll81 we have shown that the mapping from (Yi, 12) to {S, Y2) is one-to-one, 
where 

iVi No 

S = X + — Xi + — X2 + Zi 

Ni+N2 Ni + N2 (122) 

Y2 = X + Xi + Zi + Z 

where Zi and Z are independent zero mean real Gaussian random variables with variances ^^^^^ 
and j^^^, respectively. 
We define the following two auxiliary random variables: 

U,:={Wo,W2,Yr\Yr'), 
Ul:={Wo,WuYl-\Y^-'). 

We follow the steps similar to those in Appendix El and derive the following upper bounds 
n 

nRo + nR2 = ^1 ^(f^^' ^2,*|X2,,) + n52,n (124) 
i=l 



RO + nR2<J2 ^i^i'^ ^l.i' Y2,i\Xi^i,X2,i) + nS2,n = ^i^i' Si,Y2,i\Xi^i,X2,i) + n52,n 

(125) 

= ^ liUi; Si\Xi^i, X2,i) + n52,n 



i=l 



nRi < 'Y I{Xi;Yi^i,Y2^i\Ui, Xi^i, X2,i) + n(5i,„ = ^ /(X^; 5^, l2,i|f^i, ^2,i) + ?^5l,n 

(126) 

= 'Y I{Xi; Si\Ui, Xi^i, X2,i) +nSi^n 
1=1 

n 

nRo + nRi < /(C//, yi,i|Xi,,) + n^i,, (127) 

i=l 



nRo + nRi<Yl ^^^i' ^i-^' >2,i|^i,*, ^2,0 + n6i,n = ^ /(C/- ; S^,Y2,i\X^,^, X2,i) + n5i,„ 



i=l 



Y,I{Ul;Si\Xi^^,X2,i) + n5i,, 



(128) 



i=l 



R2 <Y,I{Xi-,Yi,„Y2AUiXi^i,X2,.i)+n62,n = J] /(X^; 5„ ^2,^1^7/, ^m, ^2,0 + n,52,n 

(129) 



n 

i=l 1=1 



Y,HXuS,\Ul,Xl^i,X2,^) +n62,n 



1=1 
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where for equations ()125|) . H126|) . (|128() . and (|129() . we have used the fact that the mapping from 
(Yi, Y2) to {S, Y2) is one-to-one and the fact that given (Si, Xi^i,X2,i), l2,i is independent of Ui and 

We further bound equations 1)124(1 . I|125|) and p26|) by following similar steps in bounding equa- 
tions (|7n|) and (|77j) in Appendix El with Yi being replaced by 5 and A^i being replaced by 
-^^^q^^. We then obtain the following bounds 



n , 



uRq + ni?2 < - log I IH aP + N2 j ^ 



ni?o + ni?2 < ^log (l + — ^^^^ ) +n52,„, (130) 

n ( aP \ 

nRi < - log 1 + ^^^^ + nSi^n 

\ N1+N2 / 



where parameters a and f3 are defined by 



J2HS^\Xl,,,X2,^,U,) = ^log27re Lp + jp^ 

i=l 12 



:i3i) 



1 

-J2^{E^{X,\X,,„X2,i)) =PaP 

i=l 

We also obtain the following intermediate bound which will be useful for the rest of the proof 

f2h{Si\X,,i,X2,i) < ^ log 27re (^aP + (3aP + j^^'^^^^ ) (132) 

We now further bound ()127|) 

n 

1=1 

n 

= Y,HYiMXi,i) - h(Yi,i\Ul,Xi,„X2,i)+n5i,n 
1=1 

n 

< h{Xi + X2,i + Zi^i) - h{Yi,i\Ul, Xi^i,X2,i,Xi) + n5i,„ (133) 

i=l 

"1 n 

< ^ - log 27re{E{Xi + X2,^f + iVi) - ^ log 27reiVi + n5i,„ 

i=l 

< ^ log 27re ^ E(Xi + X2,if + ^1 j " ^ log 27reAfi + n6i,n 
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For the sum in the preceding equation, we have 

n l" 1*^ r)" 

i=l i=l i=l i=l 

2 " 

<P + P2 + -Ve (X2,iE(X,|Xi,„ X2,.)) 
1=1 



< P + P2 + - E \/e^2, • E (E2(X,|Xi,„ X2,0) (134) 



2 = 1 



< P + P2 + 2 



<P + P2 + 2\ P2f3aP 



\ 



^EEAt.V(^EE(E2(X,|Xu,X,,)) 



n — ' ' / \ n 

, i=i / \ i=l 



Hence we have, 



nRo + nRi< -log \l^ \ + ndi^n (135) 



We next bound (fT^ 
uRq + nPi 

n 



1=1 



= ^/l(5i|Xi,i,X2,i) - /l(5,|C/i,Xi,i,X2,,) +n5i,n 
i=l 

< ^ log 2vre (aP + /5aP + ^^1^) - ^ log 2vre (7(0^ + P^P) + ^^^) + 



n / 7(aP + /3aP) \ 
< - bg 27re 1 + ^ri^^ + nJi , 



where we used the fact that there exists a 7 € [0, 1] such that 



(136) 



h{S,\Ui ^1,., ^2,0 = ^ log 2ne (^-f{aP + /?aP) + ^^^) ■ (137) 



The preceding equation follows from 



f2KSi\UiXl^,,X2,i)<f2HS^\Xl,i,X2,^) < ^ log 27re (aP + /3aP + ^'^^^ ] , (138) 

1=1 i=l ^ 12/ 



and 

Y,HSi\Ul,Xl,i,X2,^) >Y,HSi\Ul,X,,,,X2,^,X,) = ^log27re^^-^^. (139) 



1=1 1=1 
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We finally bound (IT^ 

n 

nR2 < I{Xi; Si\Ul, Xi^i, X2,i) + n52,n 

i=l 
n 

J2HSi\Ul,X,^,,X2,^) - h{Si\Ul,X,^,,X2,i,Xi)+n62,n 

i=i (140) 



2 ^("^ + + N^2 j " 2 '"^iV^ + 

-log27re[l+ ^^^i; I +n62,n 
\ N1+N2 J 
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